r 


AD-A013  241 


SEQUENTIAL  TESTS  FOR  2X2  CONTINGENCY  TABLES 
William  Q.  Meeker , Jr. 

Union  College 


Prepared  for: 

Office  of  Naval  Research 


31  May  1975 


DISTRIBUTED  BY: 


National  Technical  Information  Service 
U.  S.  DEPARTMENT  OF  COMMERCE 


AD  A 0 i 3 2 4 


i m 023 


rH 


i 

I 


SEQUENTIAL  TESTS  FOR  2x2  CONTINGENCY 
TABLES 


AES-7507 


X* 


AUG  5 I9B5 


Reproduced  by 

NATIONAL  TECHNICAL 
INFORMATION  SERVICE 


US  Department  of  Commerce 
Springfield,  VA.  22151 


ADMINISTRATIVE  AND  ENGINEERING  SYSTEMS  MONOGRAPH 


t . 


I 


1 


Unclassified 


security  Classification  or  this  page  r*Ti»n  n»i*  Knitted) 


REPORT  DOCUMENTATION  PAGE 


» REPORT  NUMBER  2.  GOVT  ACC  CSSION  NO.  >•  RECIPIENT'S  CATALOG  NUMBER 

AES-7507  ft  ^ - /-•  ?;  r)  -i  , 


» Tyre  or  report  a rtmoo  covERto 

Final — Jan.  1,  1975  to 


4 title  (ond  Subtitle) 


SEQUENTIAL  TEST^OR  2x2  CONTINGENCY 


TABLES 


Dec.  31,  1975 


I.  performing  org.  report  number 


7 AuThORi'.J 

William  Q.  Meeker,  Jr.. 


I.  CONTRACT  OR  ORANT  NUMBERS 

N00014-75-C-0583-0002 


I.  PERFORMING  ORGANIZATION  NAME  ANO  ADDRESS  to.  PROGRAM  ELCM 

_ . , _ _ . , AREA  4 PORK  U 

Institute  of  Administration  & Management 

Union  College,  Schenectady,  NY  12308  NR  042-302 


10.  PROGRAM  ELEMENT.  PROJECT.  TASK 
AREA  4 WORK  UNIT  NUMBERS 


M.  CONTROLLING  OFFICE  NAME  AND  ADORESS 


12  REPORT  DATE 


Office  of  Naval  Research  May  31,  1975 

Department  of  the  Navy,  Arlington,  Va.  number  of  paces 

i Z S 


MONITORING  AGENCY  NAME  4 ADDRESS^!/  dllltront  Iron  Controlling  Olllet)  IS.  SECURITY  CLASS,  (ol  thto  r.porlj 

Unclassified 


IS*.  '^CLASSIFICATION  DOWNGRADING 

schedule 


14.  DISTRIBUTION  STATEMENT  (ol  Ihlt  Koporl) 


Approved  for  public  release;  distribution  unlimited 


17.  DISTRIBUTION  STATEMENT  (ol  Ih*  *4 tlrool  ontorod  In  Block  20,  II  dtlloronl  Itooi  Repot!) 


It-  SUPPLEMENTARY  NOTES 


Part  II  of  Ph.D.  dissertation  at  Union  College. 

Presented  at  Eastern  Regional  Meeting  of  IMS  and  SPES  of  ASA, 
Rochester,  N.Y.,  May,  1975. 


tl  KEY  WORDS  (Continue  on  ravint  oido  II  necoeeory  and  Identity  by  block  number) 


Direct  method,  cross-product,  odds -ratio, --two- sample  binomial, 
contingency  table,  sequential  analysis 


PRICES  SUBJECT  TO  CHANGE 


20.  ABSTRACT  (Conllnuo  on  tororto  tldo  II  notottory  and  Identity  by  block  nuatbot)  , 

This  report  deals  with 

sequential  tests  of  problems  which  ean  be  formulated  in  terms  of  a 
2x2  contingency  uable.  All  of  the  important  cases  (marginal  prob- 
abilities known  and  unknown  and  marginal  populations  "observable" 
and  "not  observable")  are  treated.  Theory  for  finding  the  sequen- 
tial test  regions  is  developed  and  the  exact  values  of  the  impor- 
tant test  properties  are  found  using  Aroian's  direct  method  of  se- 
quential analysis.  The  tests  are  rnmparpri  wi  J-h  fivpri  sitp 


DD  ijSJTtj  1473  edition  OF  I NOV  4.  II  obsolete  ' Unclassified 

S/N  0102*014*4441  I 1 UnCiaS^jK  ISA _ 

SECURITY.  CLASSIFICATION  OF  THIS  PAOE  fBTian  Dal*  Bntorod) 


20.  tests  and  a method  of  estimation  is  presented, 
examples  and  computer  programs  are  included. 


I 0-* 


Numerical 


k 


I 

I 

I 


AES-7507 


I 


SEQUENTIAL  TESTS  FOR  2x2 
CONTINGENCY  TABLES 


by 

William  Q.  Meeker,  Jr, 


May,  1975 


1 

4 


Prepared  under  Office  of  Naval  Research 
Contract  N0001 4-75-C-058 3-0002 
{Task  NR  042-302) 


L.A.  Aroian,  Project  Director 


UNION  COLLEGE  AND  UNIVERSITY 
Institute  of  Administration  and  Management 
Schenectady,  New  York  12308 


ziA’n-niMrr  X* 

Approvt  i toj  putuc  ibiituMj 
Dt-inbuuon 


tilinWlMlMiUlifiiifliy. 


mrnmm 


ABSTRACT 


This  report  deals  with  sequential  tests  of  problems 
which  can  be  formulated  in  terms  of  a 2x2  contingency  table. 
All  of  the  important  cases  (marginal  probabilities  known  and 
unknown  and  marginal  populations  "observable"  and  "not 
observable")  are  treated.  Theory  for  finding  the  sequential 
test  regions  is  developed  and  the  exact  values  of  the  impor- 
tant test  properties  are  found  using  Aroian's  direct  method 
of  sequential  analysis.  The  tests  are  compared  with  fixed 
size  tests  and  a method  of  estimation  is  presented.  Numerical 
examples  and  computer  programs  are  included. 
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INTRODUCTION 

This  report  presents  theory  and  methods  for  treating 
sequentially  certain  problems  which  can  be  formulated  in  terms 
of  2x2  contingency  tables.  The  report  is  organized  as  follows. 
Chapter  1 contains  some  preliminary  material,  including  a dis- 
cussion of  the  different  models  which  arise  with  the  treatment 
of  2x2  contingency  tables.  Chapter  2 treats  some  general 
topics  related  to  sequential  analysis  which  are  common  to  all 
of  the  models  considered  here.  Chapters  3,  4 and  5 show  how 
to  develop  sequential  tests  and  evaluate  exactly  their  prop- 
erties, for  three  important  models  of  the  2x2  contingency 
tables.  Numerical  examples  are  provided  and  the  tests  com- 
pared with  other  similar  tests,  both  fixed  size  and  sequential 
(when  available) . Chapter  6 presents  a method  which  can  be 
used  to  estimate  the  parameters  of  a 2x2  contingency  table  at 
the  termination  of  a sequential  hypothesis  test.  Chapter  7 
summarizes  the  results,  discusses  some  possible  areas  for 
further  research  and  ends  with  some  concluding  remarks.  Compuuer 
programs  used  to  perform  the  necessary  computations  are  given 
in  the  Appendix. 
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CHAPTER  1 


DISCUSSION  OF  2x2  TABLES  AND  REVIEW  OF  THE  LITERATURE 
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1.0  INTRODUCTION 

This  chapter  introduces  2x2  contingency  tables  and  treats 
some  of  the  common  methods  of  analysis  which  have  been  used  for 
them.  In  general,  2x2  tables  are  used  to  test  independence  of  a 
bivariate  Bernoulli  process.  The  first  section  discusses,  in 
general,  the  tests  of  independence  to  be  considered  here.  The 
different  types  of  2x2  contingency  tables  can  be  divided  into 
two  broad  groups,  tables  for  which  the  marginal  probability  func- 
tions ire  known  and  tables  for  which  marginal  probability  functions 
are  unknown.  These  cases  are  discussed  in  Sections  1.2  and  1.3 
respectively.  The  fixed  size  tefct  procedures  for  these  cases 
are  also  reviewed.  Section  1.4  surveys  the  different  types  of 
problems  which  can  be  formulated  in  terms  of  a 2x2  table. 

Some  approximate  methods  of  treating  contingency  tables 
2 

(e.g.,  the  x test)  are  only  appropriate  when  the  sample  size  is 
sufficiently  large  to  meet  certain  conditions.  For  small  samples, 
some  exact  methods  (i.e.,  methods  which  are  not  based  on  any 
asymptotic  approximations)  have  been  proposed.  It  is  these  exact 
methods  for  small  samples  which  are  treated  sequentially  here. 

The  exact  methods  are,  in  theory,  equally  applicable  to  large 
samples;  however,  the  necessary  computation  becomes  laborious, 
if  not  prohibitive,  with  presently  available  computing  machinery. 
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1.1  TESTS  OF  INDEPENDENCE 

This  section  introduces  some  of  the  preliminaries  necessary 
for  the  treatment  given  here  to  sequential  tests  of  2x2  con- 
tingency tables.  As  explained  in  detail  below,  one  is  interested 
in  testing  for  independence  or  for  some  degree  of  dependence 
between  the  rows  and  columns  of  a 2x2  contingency  table.  De- 
pending on  the  underlying  probability  model  of  the  situation 
being  considered,  the  degree  of  dependence  can  be  expressed  in 
terms  of  a single  parameter,  say  6.  There  is  one  particular  value 
of  9,  say  0Q,  for  which  the  hypothesis  of  independence  is  true. 
There  is  positive  dependence  in  the  table  if  9<0O  and  negative 
dependence  if  0>0g*  The  probability  models  and  the  particular 
value  of  0 to  be  used  for  each  are  described  in  the  following 
sections. 

In  a two  decision  test,  the  hypothesis  might  be  expressed, 
for  example , as 

v 6 - eo 

d.i) 

Hr  9 ■ V9o 

Hq  is  usually  known  as  the  null  hypothesis  and  is  the  alterna- 
tive hypothesis  and  may  be  either  simple  or  composite.  When 
testing  this  hypothesis,  there  are  two  types  of  errors  with  which 
one  must  be  concerned.  These  are  shown  in  Figure  1.1. 
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Decision  Based  on  Test  Results 


True  State 
of  Nature 


Figure  1.1  Error  Probabilities  for  a Two  Decision  Test 


H0  Hi 


No  Error 

a Error 

3 Error 

No  Error 

The  first  is  called  a Type  I or  a error  and  is  made  when 
there  is  a decision  to  reject  HQ  when  it  is  true;  the  proba- 
bility of  committing  such  an  error  is  usually  denoted  by  u. 

A Type  II  or  6 error  occurs  when  the  null  hypothesis  is  accepted 
when  in  fact  some  specified  alternate  hypothesis  is  true.  The 
probability  of  such  an  error  is  usually  denoted  by  ft.  The 
following  notation,  however,  is  used  here.  Let  a and  B denote 
the  desired  probabilities  of  the  Type  I and  Type  II  errors  re- 
spectively and  let  a’  and  3'  denote  the  actual  error  probabilities 
of  the  sequential  tests. 

When  a three  decision  test  procedure*  is  being  used,  one  of 
the  three  hypotheses  must  be  selected.  These  hypotheses  can  be 
specified  as 


Hr  9 - ei<eo 


Ho;  8 =6o 


(1.2) 


H2:  9 =82>eo 


The  three  decision  test  is  a generalization  of  the  standard  two- 
sided  test;  that  is,  separate  a and  3 errors  can  be  specified 
for  each  alternate  hypothesis  (see  Goss  (1974b)). 
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In  this  case,  there  are  four  types  of  errors  which  can  be  made; 

is  the  probability  of  accepting  when  is  true  and  0^ 
is  the  probability  of  accepting  or  when  is  true;  <»2 
is  the  probability  of  accepting  H2  when  HQ  is  true,  and  #2  is  the 
probability  of  accepting  H ^ or  HQ  when  H2  is  true.  These  error 
probabilities  are  shown  in  Figure  1.2. 


Decision  Based  on  Test  Results 


H1 

Ho 

H2 

H1 

No  Error 

B Error 

True  State  H 
of  Nature 

Error 

i 

No  Error 

a2  Error 

H2 

S2  Error 

1 

No  Error 

Figure  1.2  Error  Probabilities  for  a Three  Decision 
Test 


The  following  sections  of  this  chapter  will  treat  the 
individual  cases  which  arise  with  2x2  contingency  tables.  The 
underlying  probability  models  are  discussed  and  fixed  size  pro- 
cedures are  examined.  In  the  succeeding  chapters,  sequential 
methods  for  testing  these  hypotheses  are  treated. 

1.2  CONTINGENCY  TABLES  WITH  KNOWN  MARGINAL  PROBABILITIES 


The  underlying  probability  model  of  a 2x2  contingency  table 
is  a bivariate  Bernoulli  process.  This  is  illustrated  in  Figure 

1.  3. 


Aikaifii 
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Dark  Eyes  Light  Eyes 

D D 


Figure  1.3  Probabilities  in  a 2x2  Table 


The  observations  from  this  model  are  assumed  to  be  identically 
and  independently  distributed.  Such  a situation  arises  when  one 
samples  from  an  infinite  population  (or  from  a finite  population 
with  replacement)  and  the  presence  or  absence  of  two  attributes 
is  observed  at  each  trial. 

If,  for  example,  the  event  D represents  dark  eyes  and  the 
event  E represents  dark  hair  observed  on  a person  selected  at 
random  with  replacement  from  a specified  population,  P^r  P^' 

P2^  and  in  Figure  1.3  are  the  joint  probabilities  of  observing 
the  respective  combination  of  attributes.  This  model  is  more 
conveniently  represented  as  in  Figure  1.4  which  expresses  the 


Figure  1.4  Probabilities  in  a 2x2  Table 


p 

f 


model  in  terms  of  only  three  parameters.  This  notation  will  be 
used  below. 

The  test  to  be  performed  in  this  model  is  of  independence 
between  the  two  characteristics  being  observed.  The  null  hypothesis 
of  independence  can  be  stated,  for  example,  as 


P11 


P 


1 


(1.3) 


or 


pll(1-pl."p.l+pll) 

(p.l“pll)(pl.“pll) 


(1.4) 


implying,  for  the  above  example,  that  dark  eyes  do  not  tend  to 
occur  more  often  with  the  characteristic  dark  hair  than  with 
light  hair.  The  statements  in  (1.3)  and  (1.4)  can  be  shown  to 
be  equivalent. 

In  this  section  the  marginal  probabilities  (i.e.,  p and  p ) 

1-  * • -l 

are  assumed  known.  Such  a case  might  occur  in  the  example  given 
above  if  the  characteristics  of  hair  and  eye  color  had  been  studied 
independently,  but  no  information  is  available  on  the  frequency 
with  which  they  tend  to  occur  together.  The  underlying  distribu- 
tion can  also  be  expressed  as  a multinomial  distribution  with  four 
cells.  If  the  observed  data  from  a sample  of  size  n is  represented 
as  in  Figure  1.5, 


D D 


X 

n.  - x 

X • 

nl. 

n . -x 

n-n.  - n x 

X • • X 

n - nlm 

n.l 

n - n x 

n 

Figure  1.5  Observed  Contingency  Table 
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the  probability  of  observing  this  data  can  be  expressed  as 


(1  .r>) 


n,  -x  n 1 -x  n-n  .-n.  tx 

n^hipi.-pn)  ' ‘ (1~P1.~P.1+Pn) 

x!  (n1  -x)  ! (n  -x)  ! (n-n.  -n  +x)  ! 

X • • 1 1 i , 1 


Because  p.  and  p . are  assumed  known,  the  hypotheses  to  be 

X • • X 

tested  are  specified  as 


V 

Pu'Pi.p.i 

versus  H : 
a 

pii^i.p.i 

This  hypothesis  is  discussed  in  detail  in  Chapter  3 where  it  is 
shown  that  the  triplet  (n.  ,n  ,x)  is  a minimal  sufficient  statistic 

X • • X 

for  the  state  of  nature  (P^)  • 

An  exact  fixed  size  procedure  for  small  samples  can  bo  con- 
structed to  test  (1.6)  by  ordering  the  multinomial  probabilities 
for  all  of  the  possible  occurrences  under  the  null  hypothesis  and 
partitioning  off  a critical  region  consisting  of  those  points  with 
the  smallest  probabilities  which  favor  and  which  sum  to  the 
desired  significance  level.  The  power  of  the  test  can  be  found  by 
finding  the  probability  of  observing  a point  in  the  critical  region 
under  specified  alternatives  to  the  null  hypothesis. 

For  large  samples,  the  computation  necessary  for  the  above 

2 

tests  becomes  laborious.  The  x distribution  provides  an  easy-to- 

2 

use  approximation  to  the  null  distribution  of  the  test.  The  x 
test  is  constructed  in  the  usual  manner  (for  the  approximation  of 
a multinomial  distribution)  except  that  the  proper  number  of  degrees 


IJII4  9.1.1,  >11  >11. l< ■ 1 1 *1  i l " 


T-If"-5'"-  *rV 
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of  freedom  is  three  because  the  parameters  p and  p . are  known. 

X • • i 

2 

Guttman  et  al.  (1971)  give  an  example  of  the  use  of  the  y approx- 
imation for  this  case;  it  is  also  treated  by  Rao  (1952) . In 
Chapter  3,  exact  sequential  tests  for  such  hypotheses  are  devel- 
oped . 

There  are  two  special  cases  of  2x2  contingency  tables  with 
known  marginal  probabilities.  The  first  arises  when  both  mar- 
ginal totals  are  random  variables  and  only  one  of  the  marginal 

probability  distributions  is  known.  Not  much  treatment  seems  to 

2 

have  been  given  to  this  case  in  the  past.  The  y approximation 
with  two  degrees  of  freedom  is  appropriate  for  large  samples. 

The  other  special  case  arises  when  one  of  the  marginal  distribu- 
tions is  "observable."  "Observable"  in  this  case  means  that  the 
distribution  from  the  margin  can  be  controlled  by  the  experimenter 
in  some  way  and  is  not  a random  variable  except  in  its  relations 
to  the  sample  size  in  a sequential  test.  This  means  that  a se- 
quential (or  fixed  size)  test  can  be  constructed  such  that  a de- 
sired proportion  of  units  can  be  taken  from  each  category  of  the 
"observable"  margin  at  each  stage  of  the  test.  Lehmann  (1959) 
points  out  that  tests  which  take  equal  numbers  from  each  category 
are  asymptotically  most  powerful. 

The  case  where  one  margin  is  "observable"  and  the  other  is 
random  with  an  unknown  probability  distribution  is  treated  in 
the  next  section.  The  case  where  one  margin  is  "observable"  and 
the  other  is  random  with  a known  probability  distribution  reduces 
to  a simple  binomial  distribution  if  one  samples  exclusively  from 
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one  of  the  characteristics  of  the  "observable"  marqin.  This 
test  can  be  shown  to  be  asymptotically  most  powerful  (Lehmann, 
1959)  and  can  be  treated  sequentially  by  using  a simple  binomial 
procedure.  (See  Ghosh  (1970),  p.282).  The  case  where  both 
margins  are  "observable"  is  mentioned  briefly  in  the  next  section. 

1.3  CONTINGENCY  TABLES  WITH  UNKNOWN  MARGINAL  PROBABILITIES 

The  treatment  of  2x2  tables  with  unknown  marginal  proba- 
bilities, as  described  in  this  section,  has  been  a classical 
problem  in  the  field  of  mathematical  statistics.  It  is  particu- 
larly interesting  because  of  the  controversies  which  have  arisen 
concerning  their  proper  treatment.  A brief  history  of  the  re- 
sults obtained  with  this  well-known  model  is  given  here.  The 
model  considered  in  this  section  is  the  same  bivariate  Bernoulli 
process  discussed  in  the  last  section,  except  that  here  both  of 
the  marginal  probability  distributions  are  assumed  to  be  unknown. 
The  hypothesis  of  independence  being  tested,  however,  is  the  same. 
The  unknown  marginal  probabilities  p and  p are  so-called 
"nuisance  parameters,"  causing  the  method  of  testing  with  small 
samples  to  be  quite  different.  This  subject  is  treated  in  detail 
in  Chapters  4 and  5. 

Karl  Pearson  (1900)  was  apparently  the  first  to  treat  the 

2 

problem  when  he  suggested  the  x distribution  as  an  approximation 
to  the  test  of  independence.  This  is  still  the  accepted  approach 
when  the  expected  number  in  each  cell  is  sufficiently  larqe. 

There  was,  for  a time,  some  controversy  as  to  the  proper  number 
of  degrees  of  freedom  to  be  used  for  the  test.  This  was  settled 
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by  Fisher  (1922)  and  Yule  (1922)  who  show  that  when  the  marginal 
probabilities  are  unknown,  the  proper  number  of  degrees  of  freedom 
is  one. 

2 

The  use  of  the  x distribution  is  an  approximation  to  the 
true  multinomial  distribution  which  assumes  the  count  in  each 
cell  of  the  table  to  be  normally  distributed.  Because  of  this, 
it  is  necessary  that  the  expected  values  of  the  entries  in  each 
cell  of  the  table  be  of  sufficient  size  to  justify  this  assump- 


tion. In  most  cases  an  expected  number  of  5 in  each  cell  is 

2 


considered  sufficient  for  the  use  of  the  x"  approximation,  al- 
though this  is  still  a matter  of  some  controversy.  A continuity 
correction  for  the  approximation  can  also  be  used.  Recent  treat- 
ment of  this  subject  is  given,  for  example,  by  Lancaster  (1969) 
and  Fleiss  (1973) . 

Fisher  (1935)  and  Yates  (1934)  concurrently  presented  a 
test  for  2x2  tables  which  is  exact  for  small  samples.  The  test 
is  based  on  the  concept  of  ancillary  statistics  as  defined  by 
Fisher  (1935)  . Briefly,  the  test  is  constructed  to  be  conditional 
on  the  observed  margins.  In  this  case,  the  distribution  of  the 
observations  in  the  table  under  the  null  hypothesis  of  independence 
reduces  to  the  much  simpler  hypergeometric  distribution.  This 
also  produces  a much  smaller  reference  set  from  which  to  choose 
the  critical  region.  This  test  is  treated  more  completely  in 
Sections  4.2  aid  5.1. 

The  Fisher-Yates  test  (also  known  as  Fisher's  exact  test) 
led  to  a great  deal  of  controversy  among  some  of  the  most  well- 
known  mathematical  statisticians,  including  E.B.  Wilson  (Wilson, 
1941),  G.A.  Barnard  (Barnard,  1945,  1947a  and  1947b)  and 
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E.S.  Pearson  (Pearson,  1947).  Their  basic  disagreement  was  with 

T 

J 

**  Fisher's  reference  set.  Pearson  and  Barnard  believed  that  the 

test  of  significance  should  be  based  on  all  of  the  possible 
occurrences  from  a given  sample  size.  Fisher  insisted  on  limit- 
ing the  reference  set  to  only  those  different  possible  outcomes, 
given  the  observed  marginal  totals.  Fisher's  argument,  based  on 
. the  concept  of  ancillary  statistics,  as  an  answer  to  this  criti- 

cism, is  given  in  Section  4.2;  it  is  now  generally  agreed  that 
Fisher's  method  is  the  one  which  should  properly  be  used  for  the 
above  model. 

Barnard  (1947a)  surveys  the  different  types  of  2x2  tables 

i 

with  unknown  marginal  probabilities.  He  divides  the  tables  into 

three  groups,  depending  on  whether  the  margin  totals  are  random 

i 

variables  or  fixed  constants.  He  terms  these  "double  dichotomy," 
"2x2  comparative  trial"  and  "2x2  independence  trial,"  for  the 
cases  where  neither,  one,  and  both  margins  are  fixed  (i.e., 
"observable")  respectively.  A brief  discussion  of  these  models 
follows. 

If  both  margins  are  random  variables,  one  is  interested  in 
the  degree  of  dependence  between  the  rows  and  columns.  If  one 
of  the  margins  is  "observable"  as  explained  in  Section  1.2, 
that  margin's  totals  can  be  controlled  by  the  experimenter.  This 
is  Barnard's  "comparative  trial"  and  can  be  used,  for  example, 
to  test  homogeneity  of  the  two  populations  with  respect  to  some 
attribute.  Although  it  is  not  necessary  to  do  so,  if  the  tost  is 
is  conducted  such  that  an  equal  number  of  observations  arc'  taken 
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from  each  category  of  the  fixed  margin,  the  asymptotic  power 
of  the  test  for  a given  significance  level  can  be  shown  to  be  a 
maximum  (Lehmann,  1959)  . An  example  of  such  a test  would  be 
selecting  n/2  people  with  dark  hair  and  n/2  people  with  light 
hair.  The  proportions  of  dark-eyed  people  in  each  category  are 
then  compared. 

If  a sample  of  fixed  size  is  selected  from  each  category 
of  one  margin,  there  are  two  parameters  in  the  model;  namely,  for 
the  present  example,  the  proportions  of  dark-eyed  people  with  dark 
hair  and  with  light  hair.  The  probability  model  is  illustrated 
in  Figure  1.6  where 


prpn/pi 


p2=(p.rpu)/(1-pi.) 


(1.7) 


Dark  Eyes  Light  Eyes 

Dark  Hair  E 

Light  Hair  E 


D D 


Figure  1.6  2x2  Table  for  Testing  P^=P2 

This  is  the  common  test  for  the  equality  of  two  unknown  binomial 
proportions  where  the  null  hypotheses  to  be  tested  can  be 
expressed  as 


14 


Pl=P2 

Px (1“P?) 
P2 (1-Px) 


(1.8) 


For  fixed  size  tests  with  large  samples,  the  normal  distribution 
approximation  can  be  used  to  test  the  hypotheses  in  (1.8). 

The  Fisher's  exact  test  (Fisher,  1935)  can  be  used  for  small 
samples,  to  treat  this  situation.  The  model  can  also  be  formu- 
lated in  a logistic  form.  This  is  done  in  Chapter  5. 

Barnard  (1945,  and  1947a)  gives  a test  of  homogeneity  which 
he  claims  is  "more  powerful  than  Fisher's."  In  this  test,  Barnard 
considers  the  larger  reference  set  of  outcomes  mentioned  above. 

The  test's  introduction  was  followed  by  some  discussion  (Fisher 
(1945),  Barnard  (1945,  1947a,  1949))  which  led  to  the  general 
consensus  that  Fisher's  test  is  the  one  which  should  properly 
be  used.  Some  further  treatment  of  this  subject  is  given  ir 
Section  4.2  and  Chapter  5,  where  sequential  tests  for  these  cases 
are  presented. 

The  other  case  delineated  by  Barnard  is  the  independence 
trial,  where  both  of  the  margin  totals  are  fixed.  This  is  situation 
illustrated  by  Fisher's  famous  tea-tasting  experiment  where  a lady 
is  to  decide  whether  the  milk  or  the  tea  was  put  into  the  cup 
first.  In  this  test  the  lady  is  informed  as  to  how  many  of  the 
cups  are  in  each  category,  and  it  is  assumed  that  her  answers  will 
correspond  in  number.  This  is  again  a test  concerning  the  inde- 
pendence of  the  marginal  characteristics.  Fisher's  exact  test 
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is  also  used  in  this  case.  Because  such  "fixed"  margin  models 
do  not  often  arise  in  sequential  analysis,  they  are  not  treated 
here. 

1.4  OTHER  PROBLEMS  FORMULATED  IN  TERMS  OF  2x2  CONTINGENCY  TABLES 

This  section  will  survey  some  of  the  statistical  problems 
which  have  been  formulated  in  terms  of  2x2  tables.  All  of  these 
cases  have  been  treated  in  the  literature  for  fixed  size  tests. 

Some  of  them  can  be  solved  sequentially  with  the  methods  given 
here.  Others  will  have  to  be  treated  in  a somewhat  different 
manner.  Some  discussion  of  these  possible  extensions  is  contained 
in  Chapter  7. 

The  three  most  commonly  used  models  for  2x2  tables  are  the 
"double-dichotomous,"  the  "comparative  trial"  and  the  "independence 
trial,"  as  named  by  Barnard  and  discussed  in  Section  1.3.  These 
are  models  with  unknown  marginal  probabilities  (for  the  random 
margins)  and  have  0,  1,  and  2 fixed  margins  respectively.  The 
"double  dichotomous"  model  is  used  for  testing  the  independence 
of  two  Bernoulli  processes.  The  use  of  such  tests  is  common,  for 
example,  in  both  medical  and  psychological  research.  The  "com- 
parative trial"  is  used  to  test  the  equality  of  two  unknown 
binomial  proportions,  or  to  test  for  independence  when  one  of 
the  populations  in  the  "double  dichotomous"  model  is  "observable" 
as  explained  in  Section  1.3.  Such  tests  might  be  used,  for 
example,  to  test  whether  a new  drug  is  significantly  more  effective 
than  a placebo  or  another  standard.  The  "independence  trial"  is 
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a test  ot  independence  between  two  fixed  marginal  totals. 

The  first  two  cases  can  often  be  treated  more  conveniently 
with  a sequential  test.  This  is  especially  true  if  the  data  are 
obtained,  or  if  the  test  is  conducted,  sequentially.  The  sequen- 
tial tests  for  these  cases  are  developed  in  Chapters  4 and  5 
respectively.  The  third  case  has  limited  applicability  within 
the  area  of  sequential  analysis. 

It  is  interesting  to  note  that  the  fixed  size  test  of  the 

null  hypothesis  for  all  of  these  cases  is  the  same.  For  small 

samples,  Fisher's  exact  test  (see  Chapter  4)  can  be  used,  and 

2 

for  large  enough  samples,  the  x distribution  with  one  degree 
of  freedom  is  appropriate.  Two  other  applications  of  the 
"double  dichotomous"  model  are  non-parametric  tests  of  location 
and  for  dispersion.  These  tests  are  treated,  for  example,  by 
Gibbons  (1971)  and  Owen  (1962). 

If  either  or  both  of  the  marginal  distributions  are  known, 
different  fixed  size  procedures  are  required,  as  explained  in 
Section  1.1.  The  sequential  procedure  to  be  used  when  both 
marginal  probability  distributions  are  known  is  developed  in 
Chapter  3. 

In  addition  to  the  above,  other  problems  have  been  formu- 
lated in  terms  of  2x2  tables  or  combinations  of  2x2  tables.  Dr. 
John  Gart  has  been  a leader  in  this  field  of  application.  Some 
of  the  problems  which  he  has  formulated  in  terms  of  2x2  tables 
include  tests  for  comparing  matched  proportions  in  crossover 
designs  (Gart,  1969)  comparison  of  several  proportions  adjusted 
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for  an  auxiliary  variable  or  covariate,  and  test  of  incidence 
rates  when  the  underlying  distribution  can  be  assumed  to  be 
Poisson  (Gart,  1974). 
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CHAPTER  2 

SEQUENTIAL  ANALYSIS  AND  THE  DIRECT  METHOD 

2.0  INTRODUCTION 

This  chapter  introduces  and  reviews  some  of  the  important 
topics  and  considerations  relating  to  sequential  analysis  which 
are  used  in  the  sequential  tests  for  2x2  contingency  tables 
treated  in  Chapters  3,  4 and  5.  The  first  section  discusses  the 
use  of  sequential  analysis  when  testing  composite  hypotheses  and 
the  basic  importance  of  the  operating  characteristic  (OC)  func- 
tion. Section  2.2  introduces  the  direct  method  of  sequential 
analysis  which  is  used  later  to  find  the  exact  properties  of  the 
sequential  tests.  The  next  section  treats  different  methods  of 
developing  sequential  tests  for  three  decision  test  procedures. 
The  last  section  explains  the  truncation  of  sequential  tests  to 
eliminate  the  possibility  of  very  large  sample  sizes. 

2.1  SEQUENTIAL  ANALYSIS  AND  COMPOSITE  HYPOTHESES 

This  section  will  consider  sequential  tests  of  composite 
hypotheses.  It  will  be  shown  here  that  the  Wald  (1947)  sequen- 
tial probability  ratio  test  (SPRT) , used  in  the  following  chap- 
ters and  based  on  pairs  of  simple  hypotheses,  can  be  used  to 
obtain  satisfactory  sequential  tests  for  composite  hypotheses. 
The  discussion  below  pertains  to  two  decision  tests,  although 
the  ideas  also  apply  to  k>2  decision  tests. 
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When  finding  a fixed  size  sample  test  to  choose  between  one 
of  two  specified  hypotheses,  one  must  specify  both  the  sample 
size  n*  and  critical  value  c*  to  give  the  desired  error  probab- 
bilities.  When  this  special  case  is  generalized  to  a sequential 
procedure  where  stopping  rules  are  selected  for  each  trial,  the 
problem  of  selection  of  the  proper  test  becomes  much  more  com- 
plicated because  there  are  many  more  possible  tests  to  choose 
from.  To  find  a sequential  test,  one  must  partition  the  sample 
space  at  each  trial  into  three  regions:  one  for  acceptance  of  liQ, 

one  for  rejection  of  and  one  for  continuation  of  the  sequential 
test . 

It  is  well  known  that  Wald  SPRT  gives  optimum  regions  for 
testing  a simple  hypothesis  against  a simple  alternative  under 
certain  conditions  (Wald  and  Wolfowitz,  1948).  Such  hypotheses 
are  stated,  using  the  binomial  parameter  p for  an  example,  as 

Hq : p=pQ  versus  H : p=p1  (2.1) 

as  shown  in  Figure  2.1.  The  hypotheses  are  represented  as  points 
if  they  are  simple,  as  in  this  case,  and  as  line  segments  if  they 
are  composite.  For  our  purpose,  we  define  simple  and  composite 
hypotheses  to  be  hypotheses  specifying  exactly  one  point  (in 
the  parameter  space),  and  more  than  one  point,  respectively. 
Statistical  tests  between  two  alternative  simple  hypotheses  imply 
that  the  experimenter  believes  that  there  are  only  two  possible 
values  for  the  true  state  of  nature.  Such  situations  do  not  often 
occur  in  practice. 
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Simple  Hypothesis 


Composite  Hypothesis 


Figure  2.1  Simple  and  Composite  Hypotheses 


In 

most 

cases  the 

hypotheses  to  be 

tested  are 

composite 

and  are 

expressed  in  a 

form  similar  to 

V 

p=p0 

versus  : 

P*Po 

(2.2) 

or 

V 

p<p0 

versus  11^: 

p>p1ip0 

(2.3) 

When  using  a statistical  test,  the  important  distinction  between 
the  simple  hypotheses  in  (2.1)  and  the  composite  hypotheses  of 
(2.2)  and  (2.3)  is  that  in  the  latter  one  is  interested  in  all 
of  the  points  of  the  OC  function  over  a specified  range  of  the 
parameter  values  given  by  the  hypothesized  states  of  nature. 

The  hypotheses  shown  in  (2.2)  do  not  contain  any  specific 
alternative  and  are  the  type  generally  specified  in  so-called 
fixed  size  sample  "tests  of  significance."  Users  of  such  tests 
generally  use  a specified  significance  level  (u  error)  and  sample 
size,  but  do  not  mention  a specific  alternative  hypotheses  and 
therefore  often  do  not  consider  the  "power"  of  their  tests. 

The  rationale  for  such  a test  is  that  there  is  a strong  prior 
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belief  in  (or  preference  for)  the  null  hypothesis,  and  that  it 
is  not  to  be  rejected  unless  there  is  strong  evidence  (i.e.,  at 
the  1-a  confidence  level)  that  it  is  not  true. 

By  examining  the  Type  II  error  (which  is  one  minus  the  power 
of  the  test  at  a specific  alternative),  one  can  determine  if  the 
significance  level  of  the  test  has  been  set  too  low  (or  too  high) 
for  a given  sample  size  or  if  the  sample  size  is  too  large  (or 
too  small)  for  the  required  sensitivity  against  alternatives  to 
the  null  hypothesis.  Either  of  these  consequences  could  be  costly. 
It  does  no  harm  for  even  the  "significance  tester"  to  investigate 
to  which  his  alternatives  his  test  will  be  sensitive.  From  this 
it  is  seen  that  it  is  important  to  examine  the  power  of  a 
statistical  test. 

In  this  light,  the  pair  of  hypotheses  in  (2.3)  is  considered. 
Here  a range  of  values  has  been  specified  for  H^,  the  alternative 
hypothesis,  as  well  as  for  H^,  the  null  hypothesis  (see  Figure  2.1). 
The  values  in  between  p^  and  p^  constitute  an  "indifference  zone." 
For  the  situation  where  one  must  make  a decision  either  for 
or  for  H^,  and  there  are  positive  costs  (tangible  or  not)  for  both 
types  of  errors,  this  is  a more  practical  way  of  specifying  the 
hypothesis  to  be  tested. 

This  again  brings  out  the  subtle  difference  between  a "test 
of  significance"  and  other  composite  tests  of  hypotheses.  A test 
of  significance  might  be  valid,  for  example,  for  a test  used  in 
proving  some  law  of  nature,  for  which  it  is  nearly  impossible  to 
specify  all  of  the  possible  alternatives.  In  contrast,  when 
testing  the  ability  of  a new  drug  to  cure  a disease,  the  situation 
is  different. 


If  the  proportion  of  successful  cures  of  a drug  is  to  be 
compared  with  that  of  a control  or  a placebo,  the  hypotheses  to 
be  tested  will  usually  be  stated  as 


Pl=P2 


versus  : Pj''P2 


(2.4) 


where  p^  and  p2  are  the  probabilities  of  a successful  cure  for  the 
control  and  the  drug  being  tested,  respectively  (both  probabilities 
being  unknown).  In  this  case,  there  are  true  costs  (although  they 
are  probably  intangible)  for  both  types  of  errors;  that  is,  for 
accepting  the  new  drug  as  "significantly  better”*  when  it  is  not 
and  for  rejecting  it  when  it  is  "significantly  better."  Because 
both  of  these  errors  are  important,  it  is  imperative  that  the 
experimenter  examine  the  power  of  his  statistical  test  so  that 
the  errors  can  be  balanced  if  necessary.  These  same  ideas  are 
important  in  the  development  of  sequential  tests  of  composite 
hypotheses . 

When  developing  sequential  tests,  it  is  usually  necessary  to 
specify  some  specific  alternatives  to  the  null  hypothesis,  so  that 
the  proper  stopping  rules  can  be  formulated  to  control  both  types 
of  errors  and  so  that  the  test  properties  of  the  sequential  test 
may  be  assessed.  If  one  wishes  to  test  a composite  hypothesis 
such  as  (2.3),  one  must  find  a sequential  test  procedure  which  has 


Here  we  mean  a difference  of  practical  significance,  rather  than 
simply  a difference  of  statistical  significance. 
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a satisfactory  OC  function  over  a specified  range  of  parameter 
values.  This  is  usually  done  with  respect  to  some  additional 
criterion  concerning  the  cost  of  sampling. 

Although  the  Wald  procedure  provides  optimal  tests  under 
certain  conditions,  there  remains  the  problem  of  finding  optimum 
sequential  tests  for  the  composite  hypotheses  considered  here. 

Wald  (.1947)  discusses  this  problem  at  some  length.  He  comes  to 
the  conclusion  that  the  test  of  the  simple  hypothesis  in  (2.1) 
can  be  used  to  approximate  a test  of  a composite  hypothesis 
such  as  (2.3)  without  much  loss  of  efficiency.  This  is  the  method 
most  commonly  used  to  find  regions  for  a sequential  test  of  a 
composite  hypothesis.  In  Chapters  3,  4 and  5,  sequential  test 
regions  are  found  by  specifying  simple  hypotheses. 

One  should  examine  the  possible  consequences  of  using  such 
an  approximation;  that  is,  carefully  examine  the  OC  function  of 
the  test.  If  the  resulting  OC  function  is  not  close  to  the 
desired  OC  function,  the  test  region  can  be  modified  so  that  it  is. 
This  is  briefly  discussed  in  Section  3.3. 

2.2  THE  DIRECT  METHOD  OF  SEQUENTIAL  ANALYSIS 

The  direct  method  of  sequential  analysis,  given  by  Aroian 
(1968),  describes  a general  method  whereby  the  exact  properties 
of  a given  sequential  test  region  may  be  obtained.  Since 
Aroian's  1968  article,  the  method  has  been  used  in  a variety  of 
applications,  including  tests  for  the  mean  of  a normal  distribu- 
tion with  the  standard  deviation  known  (Aroian  and  Robison,  1969) 
and  unknown  (Schmee,  1974),  two  sided  tests  of  the  normal  dis- 
tribution with  the  standard  deviation  known  (Goss,  1974b) 


24 


sequential  rank  tests  (Elfring  and  Schultz,  1973b),  tests  of  the 
binomial  distribution  (Corneliussen  and  Ladd,  1970  and  1971),  and 
tests  of  a normal  distribution  with  mean  known  and  unknown 
(Aroian,  Gorge,  Goss  and  Robison,  1975). 

Before  using  a sequential  test  procedure,  one  should  know 
or  have  available  reasonable  approximations  to  the  actual  test 
properties.  The  most  important  test  properties  are  the  true  u 
and  6 error  probabilities  (denoted  a'  and  H'  here)  and  the  ex- 
pected or  average  sample  number  (ASN) . A typical  ASN  function 
for  a state  of  nature  which  can  be  expressed  in  one  dimension 
(e.g.,  the  binomial  parameter  p)  is  shown  in  Figure  2.2.  Also 
of  interest  is  the  operating  characteristic  (OC)  function  which 
gives  the  probability  of  accepting  the  null  hypothesis  as  a 
function  of  the  state  of  nature.  A typical  OC  function  for  a 
one-diinensional  state  of  nature  is  shown  in  Figure  2.3.  If  the 
state  of  nature  must  be  defined  in  two  dimensions,  these  functions 
can  be  represented  as  contours  or  by  single  graphs  with  one  param- 
eter being  held  constant.  If  more  than  two  dimensions  are  nec- 
essary to  describe  the  state  of  nature,  it  will  be  best  to  show 
the  test  properties  in  tables.  The  true  u and  3 error  probabilities 
for  a two  decision  procedure  are  obtained  directly  from  the  OC 
function  as 


u'=l-OC(p0) 

B^OCfpj.) 


(2.5) 


where  pQ  and  p^  are  the  parameters  specified  by  the  null  and 
alternate  hypotheses  respectively. 


I' 

> 


I 

j Another  interesting  test  characteristic,  which  is  often 

neglected,  is  the  distribution  of  the  decisive  sample  number 
(DSN);  that  is,  the  probability  mass  function  of  the  sample  size 
necessary  to  reach  a decision.  This  distribution  is  a function 
of  the  true  state  of  nature.  From  this  distribution,  one  can 
obtain  the  ASN,  the  variance  of  the  sample  number  (VSN)  or  other 
moments.  The  direct  method  is  also  used  to  find  the  distribution 
of  the  DSN.  A typical  probability  mass  function  for  the  DSN  is 
shown  in  Figure  2.4. 


In  general,  the  direct  method  is  carried  out  as  follows. 

Once  the  sequential  test  region  (i.e.,  the  sequential  test  rules) 
has  been  specified,  one  chooses  a state  of  nature,  which  allows  the 
computation  of  the  probability  of  accepting  each  possible  hypothesis 
at  the  first  trial.  The  remaining  probability,  that  is,  the  prob- 
ability of  being  in  the  continuation  region,  is  spread  out  among 
all  the  possible  values  of  the  sample  statistic  which  are  included 
in  the  continuation  region.  At  the  second  trial,  another  sample 
is  taken.  It  is  again  necessary  to  find  the  probability  of  accept- 
ing each  hypothesis  and  the  distribution  of  the  probability  of 
remaining  in  the  continuation  region.  Using  convolutions,  one  may 
continue  this  process  at  each  succeeding  trial  or  until  the  prob- 
bability  of  remining  in  the  continuation  region  is  so  small  as  to 
be  insignificant.  This  entire  procedure  is  then  repeated  using 
different  values  for  the  true  state  of  nature,  each  giving  a point 
on  the  OC  function  and  a distribution  of  the  DSN.  This  procedure 
is  used  in  Chapters  3,  4 and  5 to  find  the  exact  properties  for 
sequential  tests  of  2x2  contingency  tables. 
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2.3  METHODS  FOR  THREE  DECISION  SEQUENTIAL  TEST  PROCEDURES 

In  this  section,  the  procedures  for  developing  three  decision 
sequential  tests  are  reviewed.  Three  decision  tests  are  often 
necessary  in  practice.  An  example  of  such  a test  would  be  the 
comparison  of  two  drugs  where  one  might  be  interested  in  testing 
the  proportion  of  successful  cures  in  a controlled  test.  The  hy- 
potheses to  be  tested  might  be  expressed  as 


V 

P1>P2 

versus  Hq  : 

P1=P2 

(2.6) 

versus  h : 
2 

P1<P2 

where  p.^  and  p2  represent  the  proportion  of  successful  cures  for 
drug  1 and  2 respectively.  One  might  also  use  such  a test  to 
distinguish  among  lots  of  items  which  are  of  superior  quality 
(for  which  some  incentive  bonus  might  be  given) , standard  quality 
and  substandard  quality.  The  hypotheses  for  this  case  might  be 


specified 

as 

Hr 

D=Di>D0 

versus 

V 

o 

Q 

II 

Q 

(2.7) 

versus 

V 

d=D2<Do 

where  D represents  the  number  (or  proportion)  of  defectives  in 
the  lot. 

The  following  is  a brief  sketch  of  the  different  approaches 
to  three  decision  tests  which  have  been  treated  in  the  literature. 
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Ghosh  (1970)  and  Goss  (1974b)  give  excellent  and  somewhat  more 
comprehensive  treatment  of  this  subject.  The  discussion  here  is 
general  in  that  it  pertains  to  no  specific  distribution.  No 
attempt  has  been  made  to  cover  the  many  applications  of  these 
tests.  For  this,  the  reader  is  referred  to  Wetherill  (1966). 

Wald  (1947),  in  his  book,  gives  a method  of  formulating  a 
two-sided  test  by  using  weight  functions.  Barnard  (1947c),  in 
r.is  review  of  Wald's  book,  mentions  an  alternate  method  which 
simply  tests  the  null  hypotheses  separately  against  the  two 
alternatives.  This  is  done  by  using  two  SPRTs  at  one  time.  The 
resulting  test  regions  are  shown  geometrically  in  Figure  2.5. 

Sobel  and  Wald  (1949) , in  their  paper,  treat  the  three  decision 
test  in  detail.  They  use  a test  similar  to  that  suggested  by 
Barnard.  The  difference  is  that  each  SPRT  is  treated  independ- 
ently of  the  other.  This  would  mean,  for  example,  that  when  line 
AB  is  crossed  by  the  path  shown  in  Figure  2.5,  we  no  longer  allow 
acceptance  of  and  concern  ourselves  only  with  the  results  of 

SPRT2.  Thus,  Hq  is  accepted  when  line  AC  is  crossed  at  point  p, 
before  a shaded  region  is  even  reached.  Sobel  and  Wald  hasten  to 
point  out  that  such  a test,  which  depends  not  only  on  the  total 
sample  results,  but  also  on  the  sample  path  (order  of  the  observa- 
tions), cannot  be  an  optimal  one.  However,  the  test  was  used  in 
their  case  because  the  independence  of  the  two  tests  enabled  th» 
authors  to  derive  approximations  for  some  of  the  properties  of 
this  three  decision  test.  The  Sobel-Wald  tests  and  their  approxi- 
mate properties  are  treated  in  detail  by  Ghosh  (1971).  Here,  we 
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Figure  2.5  A Three  Decision  Sequential  Test  Region 
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Figure  2.6  Illustration  of  the  Independence  of  the 
Sobel-Wald  Sequential  Test  Region 


use  the  direct  method  of  sequential  analysis  which  can  be  used 
to  find  the  exact  properties  of  any  specified  sequential  test 
region. 


Goss  (1974b)  , when  treating  three  decision  sequential  tests 
of  the  mean  of  a normal  distribution,  compared  the  Sobel-Wald 
test  with  the  Barnard  test.  He  used  the  direct  method  to  obtain 
exact  test  results  for  such  tests.  From  his  results,  (as  one 
would  expect  intuitively) , it  is  seen  that  the  test  with  inde- 
pendently run  SPRTs  has  a smaller  expected  sample  size,  but 
slightly  larger  error  probabilities.  The  differences,  however, 
are  quite  small.  For  this  reason  and  because  it  has  somewhat 
more  intuitive  appeal,  the  approach  suggested  by  Sobel  and  Wald 
is  used  here,  although  a decision  to  accept  a hypothesis  is 

allowed  if  and  only  if  one  enters  a shaded  region  in  Figure  2.5. 

Another  approach  to  the  three  decision  test  is  given  by 
Armitage  (1950)  . In  this  paper,  Armitage  suggests  using  three 
SPRTs  simultaneously.  The  three  SPRTs  are  constructed  to  dis- 
tinguish between  and  H^,  and  and  between  and  H^. 

This  is  shown  graphically  in  Figure  2.6. 

To  devise  the  three  decision  sequential  tests  used  here,  a 
modified  version  of  the  Sobel-Wald  procedure  (Sobel  and  Wald, 

1949)  is  used.  Following  their  treatment,  two  SPRTs  are  used 
simultaneously.  One  SPRT,  say  SPRT i , is  used  to  distinguish  be- 
tween Hq  and  . The  other  SPRT,  sa*  SPRT2 , is  used  to  distinguish 
between  and  H^.  The  procedure  for  developing  and  evaluating 
the  test  properties  of  the  three  decision  test  procedures  is 
treated  in  detail  for  the  special  cases  of  the  2x2  contingency 
tables  in  Chapters  3,  4 and  5. 
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2.4  TRUNCATION  OF  THE  SEQUENTIAL  TEST  REGIONS 

One  disadvantage  of  using  sequential  test  procedures  is 
that  because  the  sample  size  is  a random  variable,  it  is  some- 
times possible  for  the  sample  size  to  be  significantly  larger 
(although  with  small  probability)  than  the  sample  size  necessary 
for  a fixed  size  sample  test.  This  section  presents  methods  for 
truncating  sequential  tests  at  some  trial,  say  n^.  This  will 
result  in  a closed  sequential  test  whose  test  properties,  with 
respect  to  the  ASN  function,  will  be  much  improved.  The  price 
paid  for  this  improvement  is  usually  quite  small. 

When  one  wishes  to  truncate  a sequential  test  at  some  trial, 
say  nQ,  one  must  specify  which  one  of  the  hypotheses  is  to  be 
chosen  for  each  possible  value  of  the  test  statistic  (which  may 
be  multidimensional)  at  trial  nQ.  Some  general  rules  of  thumb 
for  doing  this  are  given  in  Section  3.3.  Further  modification  of 
the  region  can  be  made  on  a trial  and  error  basis,  using  the  exact 
probabilities  (obtained  by  using  the  direct  method  of  sequential 
analysis)  of  reaching  each  of  the  decision  points  in  the  sample 
space  as  a guide.  Such  careful  modification,  though  tedious, 
could  be  used  to  obtain  a sequential  test  with  test  properties 
closely  approaching  those  which  are  desired. 

Of  ter-,  when  truncation  procedures  are  put  forward,  the 
truncr  ' n ? int  suggested  is  from  1.5  to  3 times  n^  (see,  for 
example  J (1947)).  This  is  probably  because  in  the  past, 

very  lift*,  was  known  about  the  exact  properties  of  such  truncated 
tests.  When  using  the  direct  method,  however,  this  presents  no 


'w*** 


32 

problem  because  the  direct  method  is  general  and  can  be  used 
to  evaluate  any  specified  test  region.  The  sequential  tests 
presented  here  are  usually  truncated  at  the  sample  size  required 
for  a similar  fixed  size  test  (n*)  and  are  compared  with  such 
fixed  size  tests. 

When  a sequential  test  is  truncated  at  some  trial,  say  nQ, 
the  true  a and  0 error  probabilities  will  increase  by  some, 
usually  small,  amount  (when  compared  to  the  untruncated  test)  . 

If  the  size  of  this  increase  cannot  be  tolerated,  the  error  prob- 
abilities can  be  reduced  in  one  of  two  ways.  First,  the  test  can 
be  truncated  at  some  trial  nQ>n*  (i.e.,  at  some  trial  greater  than 
the  comparable  fixed  size  test).  This,  however,  will  allow  the 
sample  size  to  increase  (usually  with  small  probability)  above  n*. 
It  will  also  tend  to  a general  increase  in  the  ASN  function.  The 
other  method  is  to  modify  the  test  region  by  including  more  points 
in  the  continuation  region  for  trials  n<ng.  This  will  enable  one 
to  approach  the  a and  0 error  probabilities  of  the  fixed  size  test 
with  n^  trials  by  increasing  the  ASN  function  (which  will  approach 
a constant  function  equal  to  n^)  . 

All  of  the  sequential  tests  for  2x2  contingency  tables  pre- 
sented here  have  been  truncated.  Some  further  discussion  of  the 
particular  methods  used  to  truncate  these  tests  is  contained  in 
Section  3.3. 


CHAPTER  3 


SEQUENTIAL  TESTS  WHEN  THE  MARGINAL  PROBABILITIES 

ARE  KNOWN 


3.0  INTRODUCTION 

This  chapter  treats  sequential  methods  for  2x2  contingency 
tables  when  the  marginal  probabilities  are  known.  Section  3.1 
discusses  such  contingency  tables  and  gives  their  underlying 
probability  model.  Section  3.2  describes  the  hypothesis  being 
tested.  Sections  3.3  to  3.6  present  the  development  and  evalua- 
tion of  the  sequential  tests  for  both  two  and  three  decision  test 
procedures.  Section  3.5  also  compares  the  sequential  tests  devel- 
oped here  with  a comparable  fixed  size  test. 

3.1  2x2  CONTINGENCY  TABLES  AND  THE  MULTINOMIAL  DISTRIBUTION 

The  underlying  probability  model  for  a 2x2  contingency  table 
is  depicted  in  Figure  3.1. 
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Figure  3.1  Probability  model  for  a 2x2  contingency  table 
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Figure  3.2  Sample  from  a 2x2  contingency  table 
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Because  the  marginal  probabilities  p1  and  p . are  known,  the 
state  of  nature  is  completely  specified  by  p^.  That  is,  there 
are  no  nuisance  parameters  to  deal  with,  as  is  the  case  when  one 


As  indicated  in  Section  1.1,  this  can  be  considered  a 
bivariate  binomial  distribution.  The  two  marginal  distributions 
are  independent  if  and  only  if  p^=p^  P j • °ne  is  usually  inter- 
ested in  testing  the  hypothesis  of  independence,  although  tests 
for  any  degree  of  association  can  be  easily  constructed.  A full 
discussion  of  these  hypotheses  is  given  in  the  next  section. 

The  probability  model  in  Figure  3.1  can  also  be  expressed  as 
a multinomial  distribution.  The  probability  of  observing  the 
sample  shown  in  Figure  3.2 


nl.'X 


'f  #v*»l  . 

I 

I 

■*  or  both  of  the  marginal  probability  functions  are  unknown.  The 

triplet  (x,n,  ,n  .)  is  a minimal  sufficient  statistic  for  p.  , 
This  can  be  shown  as  follows. 

« *. 

In  order  to  show  sufficiency  one  must  show  that  the  ratio 


PF(x-nl.,n.rn'Pll,Pl.'P.l>  (3.2) 

PF(*'Bl.'n.l!n'pll’pl.'p.l> 

is  independent  of  the  state  of  nature  (see  Lindgren  (1968)  , 

p.256).  The  probability  mass  function  P_  is  as  defined  in  (3.1). 

£ 

Equation  (3.2)  is  independent  of  the  state  of  nature  if 
and  only  if 


and  x=y 


The  vector  (x,n.  ,n  ) therefore  is  the  minimal  sufficient  statistic 

X • • 1 

for  the  true  state  of  nature,  p^.  Sequential  tests  based  on  this 
statistic  are  presented  in  subsequent  sections. 

As  mentioned  in  Section  1.1,  a special  case  arises  if  one 
of  the  marginal  distributions  is  "observable"  and  one  category 
of  that  margin  can  be  sampled  from  exclusively.  Because  one  knows 
the  marginal  probability  function  of  the  other  margin,  the  problem 
reduces  to  a simple  binomial  distribution  which  can  be  used  to 
test  association  between  the  two  marginal  characteristics.  This 
greatly  simplifies  the  problem. 

If,  for  example,  n^  can  be  chosen  to  be  the  same  as  n (the 
total  sample  size) , the  distribution  of  x is 
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P(x/n1  ,p')= 


x nl  "x 

(p')X(l-p') 


(3.4) 


and  x is  a sufficient  statistic  for  p^.  The  hypothesis  to  be 
tested  is 


V 

p'=p<re.i 

versus  H.: 

where  p'  is  the  conditional  probability  of  obtaining  an  observa- 
tion in  cell  1 of  Figure  3.3,  given  the  observation  is  in  either 
cell  1 or  2. 


E 


E 


Figure  3.3  2x2  Table  Cell  Numbers 


This  hypothesis  can  be  treated  sequentially  by  using  a simple 
binomial  test  (Wald,  1947) . 


3.2  THE  HYPOTHESIS  BEING  TESTED 


This  section  discusses  the  hypothesis  being  tested  in  a 
2x2  contingency  table  when  marginal  probabilities  a1  e known.  As 
mentioned  in  the  last  section,  one  is  interested  in  testing  inde- 
pendence of  two  binomial  characteristics.  The  hypothesis  can  be 
expressed  as 


I 
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H 

versus  H 
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pn=pi.p.i 

pu^pi.p.i 


(3.6) 


As  indicated  in  Section  3.1,  p^  alone  exactly  specifies  the 
state  of  nature  in  this  case.  Two  other  equivalent  ways  of 
specifying  this  null  hypothesis  are 


X 


or  t 


pnll~pi.~p.i'|,pii) 

<pi.‘pn,(p.i‘pii! 


1 


(3.7) 


The  first  is  the  ratio  between  the  two  values  which  are  hypothe- 
sized as  being  equal;  the  second  is  commonly  known  as  the  cross 
product  ratio  and  is  treated  in  detail  in  Section  4.2. 

Thus  there  are  three  methods  of  specifying  the  alternate 
hypothesis  to  be  tested.  The  ranges  of  variation  of  the  param- 
eters mentioned  above  are 


MAX  (0,p1>+p1>-l)  < pn  < MIN  (p1>,p>1) 


MAX 


Pi.+p.r1 

pi.p.i 


X < MIN 


(3.8) 


0 < t < 00 

For  the  purposes  of  testing  the  case  with  known  marginal  proba- 
bilities considered  here,  specifying  the  alternate  hypothesis 
directly  in  terms  of  p^  is  most  convenient. 


^ ^ in  mh  Htfi ' i ^i'l r.ty 
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A three  decision  test  of  independence  for  the  above  model 
can  be  specified  as: 


V 

pirpi<po 

versus  HQ: 

pirpo=pi.p.i 

(3.9) 

versus  H2: 

pn=p2>po 

Sequential  tests  for  these  hypotheses  are  treated  in  Sections  3.4 
and  3.6. 


3.3  THEORY  FOR  SEQUENTIAL  TESTS  WITH  TWO  DECISIONS 

In  this  section,  sequential  tests  for  the  two  decision 
hypotheses  discussed  in  the  last  section  are  developed.  It  is 
assumed  that  the  marginal  distributions  of  the  bivariate  Bernoulli 
process  are  known  and  that  items  are  sequentially  selected  at 
random  from  a population  which  follows  this  distribution.  The 
hypothesis  to  be  tested  is: 


versus 


H 

H 


0 

1 


(3.10) 


The  sequential  test  for  distinguishing  between  these  two 
simple  hypotheses  is  developed  as  follows.  Following  Wald  (1947), 
the  sequential  test  is  carried  out  by  calculating  the  likelihood 
ratio  at  trial  n,  with  a sample  outcome  ( x,n.  ,n  J (see  Figure  3.2). 

• • J. 
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P_(x,n  . ,n.  ;n,p.  ,p  . ,p. ) 

Ln  /Ln  * * • «*•  * i = 

l/  o Pp(x,n<1#n1>  ,p  ^^Pq) 


(3.11) 


n.  -x  n ,-x  n-n,  -n  . +x 

P^iPi.-Pj)  *•  (p^-p,)  -1  <i-Pi.-p.i*Pi>  _ -1 

n.  -x  n . -x  n-n  -n  . +x 

Po'Pi.-Po*  (P.x-Po»  (1-Pi.-p.i+po) 


The  sequential  test  is  then  carried  out  by  using  the  following 
procedure : 


accept  Hn  if 


accept  if 


Ln^/LnQ  < B 


Ln^/Ln^  ' A 


(3.12) 


take  another  sample  if 


B < Ln^/Lnp  < A 


The  values  A and  B,  which  are  needed  for  the  test,  are  quite 
difficult  to  determine  exactly.  However,  the  approximate  values 


A = (l-B)/a,  B = e/(l-a) 


(3.13) 


given  by  Wald  (1947)  are  used.  Here  a is  the  desired  probability 
of  a Type  I error  and  B is  the  desired  probability  of  a Type  II 
error. 

To  carry  out  the  test  procedure,  it  is  usually  more  con- 
venient to  work  in  terms  of  the  log  likelihood  ratio 


£n (Ln1/LnQ)=g(x,n1^ ,n. i » Pi t rP# i 'PQ »PX) = 


x*R^-(n^  -xJ'R^-fn  ^-x) • R^+ (n-n^  -n  ^+x)-R^ 


(3.14) 
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where  R^Hn  (Pj/Pq) 

R2=ln((p  rPl)/(p  j-p0)) 

R3=*n{  (P1>'P1)/(P1 #-P0) ) 

R4=tn((l-Pl  .-P.i+P^/U-Pi.-P  .j+Pq)) 

With  this  modification,  the  test  procedure  becomes 

accept  Hq  if  in (Ln^/Ln^) <b 

accept  if  in (Ln^/Ln^) >a  (3.15) 

take  another  sample  if  b<£n (Ln^/Ln^) <a 

where  a=£n  ( (1-0)  /a)  and  b =£n  (3/ (1-u)  ) and  ^(Ln^/Ln^  is 
shown  in  (3.14). 

Because  the  test  statistic  at  each  trial  is  in  three 

dimensions,  tables  of  these  test  plans  will  be  quite  lengthy 

for  large  sample  sizes.  In  particular,  at  each  trial  n one 

must  specify  upper  and  lower  limits  on  x (the  count  in  cell  1 of 

2 

Figure  3.3)  for  each  of  the  (n+1)  different  possible  margin 
arrangements.  Another  approach,  which  might  be  used  when  a 
given  test  will  be  performed  only  once,  is  to  compute  either 
the  critical  limits  or  the  likelihood  ratio  at  each  trial  in 
order  to  decide  what  action  should  be  taken.  The  method  for 
finding  the  critical  limits  which  define  the  test  region  is 
given  next. 

Letting  cT  (n  ,n  . ,n)  denote  the  lower  limit  and 
Cy(n^  ,n  ^,n)  the  upper  limit  for  x given  the  marginal  totals 
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n.  and  n at  trial  n,  the  sequential  test  procedure  becomes 

X • • X 


accept  Hq  if 
accept  H1  if 


x<cT  (n,  ,n  . ,n) 
x»  x • • X 

x-cu(ni. ,n.i'n) 


(3.16) 


and  take  another  sample  if  cT  (n.  ,n  . ,n) <x<cM (n.  ,n  . ,n) 
where  x,  n.  , n . and  n are  shown  in  Figure  3.2.  The  values 

X • • X 

c (n.  ,n  . ,n)  and  c (n.  ,n  . ,n)  are  easily  obtained  by  inversion 
XjX*  • X U X • • X 

of  the  equations 


b=g(x,n^  ,n  ^n^  ,p  , pQ ,px ) = £n  (Ln1/LnQ) 
a=g(x,n1  ,n  ^ »n»  _ ,p^,pQ,p^)=£n (Ln^/Ln^) 

by  solving  for  x.  These  values  can  be  expressed  as 


(3.17) 


cL(n 


1.  'n_i'n)=g-1  [ (b*ni ^ »n  i ,n,Pi  ,p  i ,pQ »Pi)] 


= [(b+nx  (R2+R4)+n  1 (R3+R4)+nR4)/(R1  + R2+R;j+R4)  )] 

CU(nl.  'n.i'n)  = [g  1 (a'ni. 'n.l'n'Pi. 'P.i'Po'Pl^  +1  (3.18) 

= £(a+n^ . (R2+R4  ) +n  1 (R3+R4)+nR4)/ (R^R^R^R^J  +1 

where  the  R^’s  are  defined  in  (3.14)  and  M=[K]  is  the  greatest 
integer  less  than  or  equal  to  K. 

These  sequential  tests  of  2x2  contingency  tables  can  be 
truncated  as  indicated  in  Section  2.4.  If  the  test  is  truncated 
at  some  n,  say  n^,  one  must  choose  the  critical  values 

2 

c (n.  ,n  . ,n)  and  cri(n..  ,n  . ,n)  for  each  of  the  (nn+l)  possible 
Xj  X • • X u x • • x u 

combinations  of  values  which  the  marginal  totals  can  take  on  at 
the  truncation  trial  n^.  Some  general  rules  of  thumb  arc  given 
for  doing  this;  these  can  be  further  modified  in  order  to  give 


1 


the  test  the  desired  properties. 


As  a first  guess,  the  critical  values  are  chosen  to  be 

CL(nl. ,n.l ,n)=  [g"1  ( (a+b)/2,n1  ,n  ^n^  ,p  ^p^p^J 
c^n^  ,n  1,n)=cL(n1  ,n  ^nj+l  (3.19) 


The  value  (a+b)/2  is  used  in  an  effort  to  truncate  the  test 

while  keeping  the  true  a and  8 errors  in  the  proper  proportion. 

2 

Any  of  the  (nn+l)  values  for  c (n  ,n  , ,n)  may  be  changed 
U X • • i. 

(along  with  c (n  ,n  ,n)  such  that  the  second  equation  in  (3.19) 

U 1 * • X 

holds) . Such  changes  will  not  affect  the  ASN  function;  however, 
they  will  change  the  OC  function.  Thus,  the  truncation  can  be 
used  to  "balance"  the  a and  8 error  probabilities.  In  order  to 
make  the  best  decision  as  to  which  points  belong  in  the  acceptance 
region  and  which  belong  in  the  rejection  region  at  nQ,  one  can 
examine  the  exact  probabilities  of  reaching  the  different  points, 
(obtained  by  using  the  direct  method  of  sequential  analysis) 
under  different  specified  alternate  hypotheses. 

A numerical  example  of  the  above  procedure  for  determining 
the  sequential  test  regions  is  now  given.  Let  p =0.5  and 

X • 

p =0.5.  The  hypothesis  to  be  tested  is 

• X 


V pU=p0=pl.p.l=0'25 

(3.20) 

versus  : p^=p^=0.40 

with  desired  error  probabilities  u=0.05  and  8=0.1.  The  test  is 
truncated  at  trial  ng=25.  For  this  case,  the  critical  values  are 
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given  in  Table  3.1  for  each  trial  up  to  n=10.  These  regions 
were  computed  using  (3.17)  and  (3.18)  and  are  truncated  at 
trail  ng  using  (3.19).  They  were  computed  using  the  computer 
program  listed  in  the  Appendix. 

The  sequential  test  is  carried  out  as  follows.  At  each 
trial  an  item  is  selected  at  random  from  the  population.  The 
presence  or  absence  of  each  of  the  two  binary  characteristics 
is  noted.  For  the  observed  marginal  totals  at  trial  n,  the 
observed  value  of  x is  compared  with  the  proper  critical  limits  in 
the  table  (or  otherwise  computed  using  (3.19)  if  no  table  is 
available) . When  one  of  the  critical  limits  is  met,  the  test 
is  terminated  and  the  proper  hypothesis  is  accepted;  otherwise, 

■i 

the  test  is  continued  and  another  observation  is  taken. 

A typical  sample  for  such  a test  is  shown  in  Table  3.2 


TRIAL 


1 

2 

3 

4 

5 

6 

7 

8 


Table  3.2 

Typical  Sequential  Sample 


D E nlm 


10  0 

11  1 

0 0 1 

10  1 

11  2 

0 1 3 

0 1 4 

10  4 


1 

2 

2 

3 

4 
4 

4 

5 


x 


0 

1 

1 

1 

2 

2 

2 

2 


Here  each  inspected  item  has  the  characteristic  of  being  either 
D or  D and  being  either  E or  E.  At  trial  10,  the  observed 
results  are  summarized  in  the  table  given  in  Figure  3.4. 


\ 


I 

} 
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D 

D 

E 

2 

2 

4 

E 

3 

1 

4 

5 

3 

8 

Figure  3.4  Observed  2x2  Contingency  Table 


Comparing  the  value  x=2  with  the  proper  critical  values  for  the 
marginal  totals  n.  =4  and  n .=5,  it  is  seen  that  the  test  is 

X • • X 

terminated  and  is  accepted.  This  sequential  test  region  is 
evaluated  in  Section  3.5. 


3.4  THEORY  FOR  SEQUENTIAL  TESTS  WITH  THREE  DECISIONS 


As  explained  in  Section  2.3,  sequential  tests  for  a three 
decision  test  procedure  can  be  developed  by  simultaneously  using 
two  SPRTs . The  development  here  uses  the  same  notation  and  under- 
lying probability  model  as  the  last  section.  For  a three  decision 
test  procedure  the  hypotheses  are  specified  as: 


Hr 

pn=pi 

versus  H„ : 
0 

pu=p0>pl 

(3.21) 

versus  H„ : 
2 

pirp2>po 

In  addition,  the  desired  a and  8 error  probabilities  are  specified 
(for  each  hypothesis)  along  with  a truncation  point  nQ.  The  test 
procedure  at  each  trial  n involves  computing  two  likelihood  ratios, 
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one  for  each  hypothesis,  and  comparing  them  to  critical  values. 
The  sequential  test  rules  for  the  test  at  trial  n are: 


accept  H.  if 


accept  Hq  if 


accept  H 2 


Ln0/Ln1  < B1 
and  Ln2/LnQ  < B2 , 
Lng/Ln^  > Ax 
and  Ln2/Ln^  < B2 
LnQ/Ln1  > h1 


and  Ln2/LnQ  > 


(3.22) 


otherwise,  the  test  is  continued  by  taking  another  sample  and 
repeating  the  procedure.  Wald's  approximations  are  used  to 
find  the  values  A^,B^,A2  and  B2?  that  is, 


A^  (l-a1)/B1 
B1=a1/(1-B1) 


A2^(l-B2)/a2 

B2=B2/(1"a2) 


(3.23) 


The  values 


a1=fcn  (A^ 


b1=£,n  (B^) 


a2  = £n  (A2) 
b2=£n (B2 ) 


(3.24) 


are  used  below. 

For  this  case  it  is  again  possible,  and  usually  desirable, 

to  compute  critical  values  to  be  compared  with  the  test  statistic 

at  each  trial.  The  minimal  sufficient  test  statistic  is  again 

(x,n.  ,n  .).  The  use  of  two  SPRTs  means  that  there  are  four 
X • • X 
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critical  limits  for  each  possible  combination  of  marginal  totals 
at  each  trial.  With  observed  margin  totals  (n.  ,n  .)  (see 

X • • X 

Figure  3.2)  at  trial  n,  the  test  procedure  is  to 

accept  if  x-CL^nl  ,n  ^,n) 

and  x<dT  (n,  ,n  , ,n) 

accept  Hn  if  x>c  (n,  ,n  ,,n) 

U i>  *i  (3.25) 

and  x<dr  (n,  ,n  . , n) 

accept  H2  if  X"Cu^nl  ,n  ^,n) 

and  x>d  (n.  ,n  ..  ,n) 

Xj  X • • X 

and  take  another  sample  if  none  of  these  conditions  is  met. 

Here  cL(-),  cy  ( • ) , dL ( • ) , dy  ( • ) are  critical  limits  for  SPRT  1 
and  2 respectively.  The  critical  limits  for  the  test  are  com- 
puted (using  the  same  notation  introduced  in  Section  3.3)  as 


for  SPRT  1 

(3.26) 

eL(nl.'n.l'n)" 

^bj+nj^  (R2+R4)+n  ± (R3+R4  ) +nR4 ) / (R1+R2  + R3+R4  )J 

cU(nl.'n.l'n>" 

[(al+nl.  <R2+R4)+n  i (R3+R4)+nR4)/(R1+R2+R3+R4)] 

+ 1 

(or  SPRT  2 

dL(nl.'n.l’n)“ 

(b0+n.  (R_+R.)+n  . (R.+R.  ) + nR  ) / (R  + R + R +R  ) 

L 2 1 . 24  .134  4 1234_ 

du(ni.'n.i'n)* 

(a2+n1  (R2+R4)+n  1 (R3  + R4  ) +nR4 ) / (Rj  +R2  + R3  + R4  ) 

+ 1 

where  a^,  b^,  i=l,2  are  defined  in  (3.24)  and  the  other  notation 


is  the  same  as  is  used  in  (3.18). 


T 
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Each  SPRT  can  be  truncated  separately  in  the  same  manner 
outlined  in  Section  3.3.  The  critical  limits  used  in  (3.25) 
can  again  be  computed  either  individually  as  the  test  progresses 
or  in  tabular  form  for  the  entire  test  plan.  When  using  a three 
decision  test  procedure  one  must  compute  two  tables,  one  for 
each  SPRT.  The  preceding  is  now  illustrated  with  an  extension 
of  the  numerical  example  given  in  Section  3.3. 

Again  letting  p.  =p  . = .5,  it  is  desired  to  choose  among 

X • • X 

the  three  hypotheses 


Hi! 

P11=P1=0.10 

versus 

V 

Pll=P0=Pl.P 

t 

versus 

H2 : 

P11==P2=0*40 

(3.27) 


The  desired  error  probabilities  are  chosen  to  be  a^u^.05  and 
B^=B2=0.1.  The  critical  limits  for  the  SPRT  used  to  distinguish 

I 

between  HQ  and  are  given  in  the  example  in  Section  3.3.  The 
critical  limits  to  distinguish  between  HQ  and  H2  are  shown  in 
Table  3.3.  (Note  that  the  designation  of  a and  0 has  been  reversed 
beacuse  p^<pQ.)  A typical  sequential  sample  from  the  2x2  table 
is  shown  in  Table  3.4;  the  corresponding  2x2  table  at  trial  10 
is  shown  in  Figure  3.5.  By  examination  of  both  sets  of  critical 
values  at  each  trial,  one  finds  that  is  accepted  at  trial  10. 

The  properties  of  this  sequential  test  region  are  found  in 


Section  3.6. 


■ 


I 

1 

f Tit  bio  J.  J 

Criiu.il  V.iluoj,  for  the 

-f 

Throe  Decision  Sc^ncnlinl  Tch‘. 


trial 

hi. 


TUI 

h 


PI,.  0.500 


0.500 

ALPHA*  0 

.100 

P0* 

0,100 

UtfAl  0. 

050 

5 

h , 1 

PI. 

0.250 

trial 

<u  « 

1 h.i 

0 

1 

2 

3 

4 

5 

n 1 > 

0 1 

3. 1* 

2.14 

1. 

13 

0.12 

-1.11 

-2.10 

0 

-2.  7 -2,  a 

l.U 

0.1? 

-1. 

11 

-2.10 

•2,  V 

-2.  8 

1 

-2.  5 -?,  4 

-1.11 

-2.10 

-?. 

« 

-2.  8 

-2,  7 

-2.  a 

-2.  9 

-2.  a 

-2. 

T 

-2.  6 

-2,  5 

-2.  4 

-2.  7 

-?.  a 

-2. 

3 

-?.  4 

-2,  3 

-?,  2 

trial 

2 h.  1 

-2.  5 

-2.  4 

-2. 

3 

-2.  2 

-2.  1 

-2.  1 

hi. 

0 1 

0 

-?.  9 -2,  8 

a 

N.t 

1 

-?:  7 -2.  a 

? 

-2.  5 -2.  4 

0 

1 

2 

3 

4 

5 

a 

5il7 

4,16 

3, 

15 

2,14 

1.13 

0.12 

-1.11 

3.15 

2.14 

1. 

13 

0,12 

•1.11 

-2.10 

-?.  9 

triai 

3 N.l 

i;n 

0.1? 

-1. 

11 

-2.10 

-2,  9 

-2.  8 

-2.  7 

Nl. 

-i;u 

-2.10 

-2. 

9 

-2.  8 

-2.  7 

-2,  a 

-?.  5 

0 1 

-2.  9 

-2,  8 

-?. 

7 

-2,  a 

-2.  5 

-2.  4 

-?.  3 

0 

-1.11  -2,10 

-2i  y 

-?.  a 

-2. 

3 

-2.  4 

-2,  3 

-?.  2 

-2.  2 

1 

9 -2.  8 

-2.  5 

-2,  4 

-2. 

3 

-2,  2 

•2.  1 

-2,  1 

-2.  0 

2 

-?*  7 -?.  6 

3 

-2.  5 -2.  4 

2 

■2,  7 
•2,  3 
■2,  3 


2 i 
•2,  » -?,  a 

-2.  7 -?,  6 
•2,  5 •?,  4 
•2,  3 -2.  7 


TRIAL  7 N.l 
hi  • 


0 

1 

2 

3 

4 

5 

a 

7 

7*19 

8.18 

5,17 

4,16 

3,15 

2.14 

1.13 

0,12 

5.17 

4,18 

3,15 

2,14 

1.13 

0.1? 

-l.n 

-2,10 

3.13 

2.14 

1.13 

0,12 

-1,11 

-2,10 

-2,  9 

-2,  8 

1.13 

0.12 

•l.U 

-2,10 

-2.  » 

-2,  8 

-2.  7 

-2,  a 

1.11 

-2.  « 

-2,  8 

-2.  7 

-2,  6 

•2.  5 

-2.  4 

21  9 

•2.  7 

-2.  a 

-2.  5 

-2.  4 

•2.  3 

-?.  3 

2.  7 

•2.  5 

-2,  4 

-2.  3 

-2,  2 

-2.  2 

•?,  1 

2.  3 

•2,  3 

-2.  2 

-2.  1 

-2.  1 

-2.  0 

-2,-1 

TRIAL  4 N.l 

hi. 

0 1 

0 i : i s o,i? 

1 *1.11  -?,10 

2 -?;  * a 

3 -2.  y -2.  * 

4 -2.  3 -2.  4 


2 3 4 

-1.11  -7,10  -2.  9 

-2,  9 -1,  a -J,  7 

•2,  7 -?,  6 5 

-2.  9 -?,  4 -2,  J 

3 -2,  2 -2,  1 


trial 

a 

N.l 

hi. 

0 

1 

2 

3 

0 

9*21 

8.20 

7,1« 

«,18 

1 

7U9 

a. 18 

5,17 

4,16 

2 

51:7 

4,16 

3.15 

2.14 

3 

31 13 

2.14 

1,13 

0,1? 

4 

1113 

0.1? 

-1,11 

-2.10 

3 

-1111 

-2.10 

-2.  9 

-2,  8 

8 

-21  9 

-2.  8 

-2.  7 

-2,  6 

7 

-21  7 

-2.  6 

-?.  3 

-2,  4 

8 

-2.  3 

-2.  4 

-2.  3 

-2,  2 

4 

3 

a 

7 

8 

5.17 

4,16 

3.15 

2.14 

1 , 1 3 

3,15 

2.14 

1.13 

0,12 

-1,11 

1.13 

0.12 

-1,11 

-2,10 

-2.  9 

1.11 

-.2.10 

-2.  9 

-2.  8 

-2,  7 

2,  9 

-2.  8 

-2,  7 

-2,  6 

-2,  5 

2.  7 

-2.  6 

-2.  5 

-2.  4 

•2,  4 

2,  3 

-2.  4 

-2 , 3 

-2,  3 

•2,  2 

2.  3 

t?.  2 

-2,  2 

-2,  1 

•2,  0 

2.  1 

-2.  1 

-2,  1/ 

-2,-1 

-2.-1 

TRIAL 

hi. 


TRI 

h 


1 


9 

N.l 

0 

1 

2 

3 

4 

11*23 

10.2? 

»,21 

8,20 

7,19 

9.21 

8.20 

7.19 

8,18 

5,17 

7.19 

8.18 

5,17 

4,18 

3.13 

5.17 

4,18 

3.13 

2,1* 

1,13 

3115 

2.1* 

1,13 

0,12 

-1.11 

1.13 

0.12 

rl.ll 

-2.10 

-2.  9 

*2,10 

-2.  » 

-2.  8 

-2,  7 

-2,  8 

-2.  7 

-2,  6 

-2.  5 

-2,  a 

-2,  3 

-2,  4 

-2,  3 

*2.  3 

-2,  * 

-2,  3 

-2.  2 

-2,  1 

10 

N.l 

0 

1 

2 

3 

4 

13*25 

12,24 

11.23 

10,22 

9.21 

11*23 

10,22 

9,31 

8,20 

7,1« 

9.21 

8,20 

7,19 

4.18 

5.17 

7.19 

6.18 

5,17 

4,16 

3.15 

3 1 1 7 

4.16 

3,13 

2.14 

1,13 

3.13 

2.14 

1.13 

0,1? 

-1.11 

1.13 

0.12 

-1,11 

-2.10 

-2.  9 

-1.11 

-2.10 

-?.  9 

-2.  8 

-2,  7 

-2.  9 

-2.  a 

-r,  ' 

-2.  6 

-2.  5 

-2.  7 

-2,  a 

-2,  3 

-2.  4 

-2.  3 

-2.  5 

-2.  4 

-2,  3 

-2.  2 

-2.  1 

5 

a 

7 

8 

9 

8,18 

5,17 

«,16 

3, 

15 

2,14 

4,16 

.'.15 

2,1* 

1,13 

0,12 

2,14 

1.1  i 

0,12 

•1, 

11 

-2,10 

0.12 

-l.ll 

-2,10 

*2, 

V 

-2,  8 

-2,10 

-2.  9 

-2,  8 

-2. 

7 

• 2 , a 

-2.  B 

-2,  7 

-2,  a 

•2. 

5 

-2,  5 

-2,  6 

-2,  5 

-2.  4 

-2, 

4 

-2,  3 

-2,  4 

-2,  3 

-2,  3 

-2, 

2 

-2,  1 

-?,  2 

-2.  2 

-2.  1 

-2, 

0 

-2,-1 

-2.  1 

-2,  0 

-2,-1 

-2, 

•* 

-2,-1 

5 

a 

7 

8 

9 

10 

8,20 

7,19 

6,18 

5,17 

4,18 

3,15 

8,18 

5.1 7 

4,16 

3,1? 

2,1* 

1,13 

4,16 

3.15 

2.1* 

1.13 

0,12 

-1,11 

2.14 

1*13 

0,12 

-1,11 

-2.10 

-2.  9 

0,1? 

-1.11 

-2,10 

-2,  9 

-2,  8 

-2,  7 

-2.10 

-2.  V 

-?,  8 

•2.  7 

-2,  6 

-2,  6 

-2.  8 

-2,  7 

-2,  a 

-2,  5 

-2,  5 

*2 , 4 

-2,  a 

•2.  5 

-2,  4 

-2,  * 

-2,  3 

-2,  2 

■*,  - 

» 9 

1 * P 

2,  3 

-2,  ? 

-2,  l 

-2,  0 

-2.  2 

*?9  ✓ 

-?,  1 

•2,  0 

-2,-1 

-2.-1 

-7.  1 

(J 

-2.-1 

-2,-1 

-2,-1 

-2,-1 
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Table  3.4 

Typical  Sequential  Sample 


Figure  3.5  Observed  2x2  Contingency  Table 
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3.5  EVALUATION  OF  THE  TWO  DECISION  TEST  REGIONS 


This  section  describes  the  evaluation  of  the  sequential 
test  plans  for  2x2  contingency  tables.  The  direct  method  of 
sequential  analysis,  as  outlined  in  Section  2.2,  is  used  to 
find  the  exact  values  of  the  important  test  properties.  It 
will  be  shown  below  how  to  compute  the  OC  function  and  the 
distribution  of  the  decisive  sample  number  (DSN) . From  these  , 
one  can  also  find  the  ASN  function  and  the  true  u and  {i  error 
probabilities,  a'  and  8'.  The  two  decision  test  procedure 
obtained  in  Section  3.3  is  evaluated  as  a numerical  example. 

The  results  given  here  are  extended  in  the  following  section  to 
treat  exact  evaluation  of  test  plans  for  a three  decision  test 
procedure. 

As  explained  in  Section  2.2,  the  direct  method  is  used  by 
computing  both  the  probability  of  making  each  decision  and  the 
distribution  of  the  probability  remaining  in  the  continuation 
region  at  each  trial.  The  probabilities  at  trial  n+1  are  com- 
puted by  convoluting  the  probability  remaining  in  the  continua- 
tion region  at  trial  n with  the  sample  taken  at  trial  n+1.  This 
is  done  for  each  trial  n=l,2, . . .n^,  where  nQ  is  the  truncation 
trial  at  which  the  sequential  test  is  terminated.  In  order  to 
use  the  direct  method,  these  probabilities  are  computed  for  each 
possible  value  of  some  statistic  which  is  both  sufficient  and 
transitive.  Transitivity  of  a statistic  S implies  that  the 
distribution  of  S at  trial  n depends  only  on  the  value  of  S at 
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trial  n-1  and  the  data  observed  at  trial  n.  A transitive  sta- 
tistic is  necessary  to  compute  the  probability  of  the  values  of 
the  test  statistic  from  one  trial  to  the  next.  The  minimal 
sufficient  statistic  (x,n^  ,n  is  also  (obviously)  transitive 
and  is  used  here  to  compute  the  probabilities  necessary  for  the 
direct  method. 

Each  point  in  the  sample  space  at  trial  n can  be  denoted 

by  (x,n.  ,n  .).  From  each  point  (x,n  ,n  .)  which  is  in  the 
X • • X • • X 

continuation  region  at  trial  n,  the  statistic  will  take  on  any 
one  of  four  values  at  trial  n+1,  namely  (x+l,n  + l,n  -.+1), 

(x,n^  ,n  i+l),  (x,ni  +l,n  ^)  or  (x^^  ,n  ^)  with  the  probabilities 
shown  in  Figure  3.6. 


I 


Figure  3.6  Possible  Outcomes  at  Each  Trial 


wmmmmmmmm  m 


rm>' 
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The  procedure  begins  at  trial  0 where  the  only  possible 
"outcome"  is  (x=0,n^  =0,n  ^=0)  which  therefore  has  a probability 
of  1.  The  probabilities  of  reaching  each  point  (x,n^  ,n  ^ ) at 
trial  n for  n=l,2,...ng  are  computed  recursively  starting  with 
this  point  at  the  origin. 

As  shown  in  Figure  3.6,  the  probability  of  reaching  each 
point  inside  or  on  the  boundary  of  the  sequential  test  region  is 
a function  of  the  true  state  of  nature.  Because  the  marginal 
probabilities  p.  and  p . are  assumed  known,  the  state  of  nature 

x • • X 

is  completely  specified  by  p^  alone.  The  operating  character- 
istic (OC)  and  the  average  sample  number  (ASN ) are  functions  of 
the  true  state  of  nature  and  one  can  specify  as  many  points  as 
necessary  or  desired  at  which  to  evaluate  the  properties  of  the 
sequential  test. 

After  choosing  a particular  value  for  the  state  of  nature, 
the  probability  of  reaching  each  point  in  the  sample  space  is 
computed.  This  is  done  by  convoluting  the  probability  remaining 
in  the  continuation  region  at  trial  n with  the  sample  taken  at 
trial  n+1.  This  is  done  in  the  following  manner. 


Let  Ai^  denote  the  event  of  accepting  hypothesis  H^, 


i=0,l  and  the  event  of  being  in  the  continuation  region  at 


trial  n.  That  is 


AO  = I 
n i 

jfx,^  , n ^ ,n) 

lX:;CL,nl.'n.l'n)  ( 

ii 

c 

rH 

< 

| (x,n1  , n 1 ,n) 

| x>c0  (nj^  ,n  ^ ,n)  j 

(3.28) 

c = 

n 

j (x,nx< ,n  x,n) 

|cL(nl.'n.l'n)<X<CU<nl. 

, n 1,n) 

Ti  -i.  ii 
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The  recursive  formula  used  to  find  the  probabilities  for  each 
point  in  the  (x,n.  ,n  .,n)  space  is: 


PS<X'nl.'\l'n!  P1.'P.1'P11)= 

I (x-1, n^  -l,n  1-l,n-l)Pg (x-l,n1  -l,n  1 

+l(x,n1  , n ^-l.n-DPg (x,n1  ,n  ^^-l^n-l.-p 

+I(x,n.^-l,n  1#n-l) Pg(x,n1  -l,n  1,n-l;p 

+I(x,n1  ,n  1,n-l)Pg(x,n1  ,n  1<n-l;p1  ,p 
where 


(3.29) 

-l,n-l;p1  ,p  1,p11)p 

l.'P.l'Pll) (P.1"P11) 
l.'P.l'Pll) (P1._P11) 
.l'pll,(1“p.l+pll) 
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(1  if  x=n^  =n  ^ = 0 

0 otherwise  ' 

(1  if  (x,n.  ,n  . , n ) cC 
* 

0 otherwise 


The  indicator  function  I accounts  for  the  fact  that  the  test 
terminates  when  one  of  the  critical  values  is  reached.  Of  course, 
the  probability  of  all  of  these  points  need  not  be  computed;  one 
need  only  compute  the  probabilities  of  those  points  which  are 
inside  or  on  the  boundary  of  this  four-dimensional  sequential  test 
region  (other  points  have  probability  zero) . 

It  should  again  be  noted  that  the  probability  of  reaching 
any  point  (x,n,  ,n  .,n)  in  the  sample  space,  for  a fixed  size 

X • • X 

sample  of  size  n is  a multinomial  distribution;  that  is, 


pF(x'nl.'n.l;n'pl.'p.l’pU,= 
n -x  n . -x 

nlpn<pi.-pn>  <p.rpn> 

x!  (n.  -x)  ! (n  ,-x)!(n-n.  -n  ,+x)l 

X*  • X X • • X 


(3.30) 
n-n^  -n  ^+x 


(1'pi._p.i+pii) 
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The  probability  of  reaching  this  point  under  the  sequential 
test  rules,  as  computed  from  (3.29),  can  also  be  expressed  us 


Ps(x,n1  ,n  j^n.p^p  1»P11)=  (3.31) 

K(x,ni  ,n  j.nlp^lpj  -pn)  K (p.fPnl  -1  (1-P1.-P.i+Pll)  4 

where  x =n-n,  -n  . +x  and  K(x,n.  ,n  , ,n)  is  the  number  of  admissable 
4 1 . . 1 1 . . 1 

paths  to  the  point  (x,n.  ,n  . ,n)  . This  leads  to  a computational 
simplification  when  one  desires  (which  is  usually  the  case)  to 
find  these  probabilities  for  several  or  many  different  values  of 
the  true  state  of  nature.  If  one  computes  (using  (3.29))  the 
probability  of  reaching  a point  (s,n,  ,n  , ,n)  under  the  sequential 

X • • X 

test  rules  for  a specified  state  of  nature  p^,  the  probability 
of  reaching  that  point  under  the  same  sequential  test  rules,  but 
with  true  state  of  nature  q^  is 


ps(x,ni.,n  j^n/P^fP  1»q11)=  (3.32) 

PS(x'nl.'n.l;n'Pl.'P.l'Pll)  PF  <X,nl.  'n>1'n'P1  'p.i'qn) 

PF(X'nl.'n.l;n'Pl.-P.l-Pll) 


Pp(*)  is,  of  course,  relatively  easy  to  compute.  This  simplifi- 
cation is  used  in  the  computer  programs  (which  are  listed  in  the 
Appendix)  for  finding  the  sequential  test  properties. 

It  is  desired  to  compute  the  OC  function  and  the  distribution 
of  the  DSN  for  different  specified  values  of  the  state  of  nature. 
From  these,  it  is  a simple  matter  to  find  the  ASN  function  and 
the  true  a and  (',  error  probabilities. 


- — — 


m 


mm mm 
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The  probabilities  of  each  of  the  events  Ai  ,i=0,l  are 
computed  for  each  specified  state  of  nature  • This  is  done 


as  follows: 


P(Ain'pll)= 


(3. 33) 


n n IU 


n,£=0  n ?=0  x=IL  Ji(x'nl.-n.1-n»  ps (x' nl . ■ " . 1 : ' P1 . ’p. 1 'pll 1 


where  IL=MAX(0,n^  +n  ^-n) 

IU=MIN(nx  , n ) 

j 1 if  (x,n  ,n  . ,n) t Ai 

J.  (x,  n ,n  . ,n)=  . ..  . * 1 

1 1.  .1  ( 0 otherwise 


The  indicator  functions  i=0,l  are  used  to  sum  only  those 

probabilities  which  are  on  the  boundary  of  or  outside  the  sequen- 
tial test  region.  Once  these  probabilities  have  been  computed, 
the  distribution  of  the  DSN  can  also  be  computed. 

The  probability  mass  function  of  the  DSN  is 

P(n;p..)=P(A0  UA1  ;p  )=P(A0  ;p  )+P(Al  ,-p..)  (3.34) 

11  n nil  n il  nil 

This  is  computed  up  to  n^,  the  truncation  point  where 

c (n,  ,n  ,n)=c  (n.  ,n  .,n)+l  for  all  possible  combinations  of 

n^  and  n The  ASN  function  is  then  computed  as 


ASN  (pi;L)  =n|1np  (n;pi;L) 


(3.35) 


Other  moments  of  the  distribution  of  the  DSN  can  also  be 
found.  The  variance  of  the  DSN  is 


] 
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n0  2 

VSN(Pll)=n£“(n-ASN(Pll) )^P(n;Pll) 


(3. 36) 


Similarly,  the  k moment  about  the  origin  can  be  exPressed  as 


E(nk;p11)=n|1nkP(n;Pll) 


(3.37) 


Defining  Cn  to  be  the  event  of  being  in  the  continuation 
region  at  trial  n,  the  ASN  function  can  also  be  expressed  as 


V1 


ASN(p11)-l+nZ1  P(Cn;Pll) 


(3.38) 


This  alternate  form  is  given  by  Aroian  (1975)  and  shows  how 
the  ASN  function  "builds  up"  at  each  trial  of  the  sequential 
test.  The  OC  function  of  the  sequential  test  is  computed  as 


oc<Pn)=nIlP(AOn;Pll» 


(3.39) 


and  the  true  a and  6 error  probabilities  are 


a'=l-OC(p0) 

B'=OC(Pl) 


(3.40) 


The  computer  program  listed  in  the  Appendix  finds  both 
the  OC  and  ASN  functions  'or  a given  sequential  test  region. 

Also  computed  is  the  probability  of  continuing  to  trial 
from  trial  nQ-l(P(Cn  _^)'.  This  is  the  most  important  point  on 
the  CDF  (actually  one  minus  the  CDF)  of  the  distribution  of  the 
DSN  and  gives  the  probability  that  the  test  will  be  terminated 
at  trial  n^,  the  truncation  point.  In  general,  this  probability 
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' 11  be  large  if  the  ASN  is  also  large.  It  is  a good  measure 

to  help  one  decide  if  the  sequential  test  has  been  truncated 
too  soon. 

The  test  properties  have  been  found  for  the  sequential  test 
region  obtained  in  the  numerical  example  given  in  Section  3.3. 
The  hypothesis  being  tested  is 


V 

pirpo=0-25 

versus  H.: 

pH=pl  = 0-4° 

with  desired  error  probabilities  ot=0.05  and  3=0.1. 

These  properties  were  computed  using  the  computer  program 
given  in  the  appendix  and  are  displayed  in  Table  3.5a.  Graphs 
of  the  OC  and  ASN  functions  are  shown  in  Figure  3.7.  rt  can  bo 
seen  that  the  ASN  function  varies  between  8.73  and  15.63  and 
that  the  true  a and  6 error  probabilities  for  this  sequential 
test  are  a'=0.057  and  8'=0.085,  which  are  very  close  to  the  desired 
values . 

In  some  cases,  the  true  a and  3 error  probabilities  ob- 
tained from  a given  test  plan  turn  out  to  be  different  than  what 
is  desired  (here,  a ' =0 . 057>u=0 . 05) . In  such  cases,  modification 
of  the  test  region  at  the  truncation  point  can  be  used  to  achieve 
the  desired  error  probabilities.  Certain  points  can  be  moved  from 
the  region  for  acceptance  of  to  the  region  for  acceptance  of 
Hq.  This  can  be  done  in  a systematic  manner  by  examining  the 
probability  of  reaching  the  points  in  question,  under  the  true 
states  of  nature  specified  by  and  (these  probabilities  are 


Table  3.5a 

Teat  Properties  for  the 
Two  Decision  Example 


Pi. 

P.l 

P11 

P<V 

0.5 

0.5 

0.2300 

0.97390 

0.5 

0.5 

0.2400 

0.94064 

0.5 

0.5 

0.2500 

0.94278 

0.5 

0.5 

0.2600 

0.91855 

0.5 

0.5 

0.2700 

0.81)709 

0.5 

0.5 

0.2000 

0.84750 

0.5 

0.5 

0.2900 

0.79925 

0.5 

0.5 

0.3000 

0.74234 

0.5 

0.5 

0.3200 

0.605/7 

0.5 

0.5 

0,3400 

0.4}103 

0.5 

0.5 

0.3600 

0.29959 

0.5 

0.5 

0.3700 

0.23222 

0.5 

0.5 

0.3S0C 

0.1/339 

0.5 

0.5 

0 . 3900 

0.12434 

0.5 

0.5 

0.4000 

0.08542 

0.5 

0.5 

0.4100 

0.0561*5 

0.5 

0.5 

0.4200 

0.03510 

0.5 

0.5 

0.4300 

0.02067 

P(H1) 

ASN 

P(C  1 

n0  1 

0.02609 

8.73 

0,03671 

0.03915 

9.41 

0.05196 

0.05722 

10.13 

0.07091 

0.08144 

10.89 

0.09345 

0.11291 

11.67 

0,11900 

0.15250 

12.44 

0.14652 

0.20075 

13.19 

0.17450 

0.25765 

13.89 

0.20097 

0.39423 

15.02 

0.24061 

0,54897 

15.63 

0.24941 

0.70040 

15.58 

0,22026 

0.76777 

15.30 

0.19333 

0.82661 

14.87 

0.16112 

0.87565 

14.30 

0.12666 

0.91457 

13.63 

0.09309 

0.94391 

12.88 

0.06323 

0.96489 

12.10 

0,03905 

0.97912 

11.31 

0.02144 

Table  3.5b 

Teat  Properties  for  the 
Two  Decision  Example 
(Favoring  HQ) 


Pi. 

P.l 

P11 

P(H0) 

0.5 

0.5 

0.2300 

0.98415 

0.5 

0.5 

0.2400 

0.97672 

0.5 

0.5 

0.2500 

0.9f640 

0.5 

0.5 

0,2600 

0.95237 

0.5 

0.5 

0,2700 

0.94370 

0.5 

0.5 

0,2800 

0.90939 

0.5 

0.5 

0,2900 

0.87849 

0.5 

0.5 

0,3000 

0.88013 

0.5 

0.5 

0,3200 

0.74893 

0.5 

0.5 

0,3400 

0.60613 

0.5 

0.5 

0,3600 

0.45168 

0.5 

0.5 

0,3700 

0.3/226 

0.5 

0.5 

0,3800 

0.29545 

0.5 

0.5 

0,3900 

0.2/439 

0.5 

0.5 

0,4000 

0.18185 

0.5 

0.5 

0,4100 

0.10987 

0.5 

0.5 

0,4200 

0.08942 

0.5 

0.5 

0,4300 

0.08027 

P(H1) 

ASN 

P (c_  , 

"o'1 

0.01585 

6,73 

0.03671 

0.02328 

9.41 

0,05196 

0.03360 

10.13 

0.07091 

0.04763 

10.89 

0.09345 

0.06630 

11.67 

0.11900 

0.09060 

12.44 

0.14652 

0.12150 

13.19 

0,17450 

0,15986 

13.89 

0.20097 

0.26107 

15.02 

0.24061 

0.39386 

15.63 

0.24941 

0.54832 

15.58 

0.22026 

0.62774 

15.30 

0.19333 

0.70455 

14.87 

0.16112 

0.77561 

14,30 

0.12666 

0.83814 

13.63 

0.09309 

0.89012 

12.88 

0,06323 

0.93058 

12.10 

0.03905 

0.95973 

11.31 

0,02144 

lsion  Exarr.Dle 
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obtained  by  using  the  direct  method  of  sequential  analysis) . 

This  type  of  modification  will  of  course  result  in  some  loss  of 

power.  Table  3.5b  shows  the  test  properties  for  the  previous 

numerical  example  with  the  region  modified  in  this  manner. 

It  is  seen  that  a'  is  reduced  from  0.057  to  0.034  and  that  the 

power  (1-6')  is  reduced  from  0.915  to  0.838.  It  should  be  noted 

that  the  ASN  function  and  P (C  . ) remain  the  same  for  such 

n0_1 

modifications.  Such  procedures  for  region  modification  are  used 
in  succeeding  numerical  examples  and  are  treated  more  fully  in 
Chapter  7. 

In  order  to  show  the  relative  superiority  of  this  sequential 
procedure,  the  above  results  are  now  compared,  for  the  one-sided 
test  procedure,  with  a similar  fixed  size  sample  test.  The  fixed 
size  test  with  sample  size  n*=20  is  used.  The  critical  region 
(for  rejection  of  H^)  for  this  test  was  found  by  including  in  it 
all  of  the  points  which  favor  and  have  the  smallest  proba- 
bilities summing  to  0.057,  the  true  a error  probability  of  the 
sequential  test.  The  power  function  for  this  fixed  size  test 
is  shown  in  Table  3.6.  It  is  seen  from  this  that  the  sequential 
test  has  both  higher  power  and  an  ASN  function  which  is  uniformly 
less  than  the  fixed  size  sample  number,  n*=20. 


Mite 


te 


MHteititeteteiteill 


\ 


Table  3.6 

Power  Function  for  the  Fixed  Size 
Sample  Test  (n*=20) 


pll 

P ( H x ; p 

.2 

.0136 

.21 

.0186 

.22 

. 0250 

.23 

.0333 

.24 

. 0438 

. 25 

. 0571 

.26 

. 0737 

.27 

. 0942 

.28 

. 1193 

.29 

.1495 

.3 

.1854 

.31 

. 2274 

.32 

. 2757 

.33 

. 3300 

.34 

. 3902 

.35 

. 4552 

.36 

.5238 

.37 

. 5942 

. 38 

. 6644 

.39 

.7322 

.4 

.7952 

.41 

.8513 

.42 

. 8987 

.43 

.9363 

.44 

. 9640 

.45 

.9823 
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3.6  EVALUATION  OF  THE  THREE  DECISION  TEST  REGIONS 

This  section  describes  the  method  whereby  one  can  obtain 
the  test  properties  of  the  three  decision  sequential  test  regions 
found  in  Section  3.4.  The  evaluations  performed  here  are  similar 
to  those  in  the  previous  section;  the  preliminary  information 

presented  there  is  not  repeated  here.  Again,  the  OC  function 

l 

and  distribution  of  the  DSN  are  found,  from  which  one  can  easily 

obtain  the  ASN  f .notion  and  the  true  a and  [J,  error  probabilities. 

At  each  trial,  an  observation  is  taken  and  either  one  of 

the  three  hypotheses  is  accepted  terminating  the  test,  or  the 

test  is  continued  by  taking  another  observation.  This  can  be 

continued  up  to  trial  n_,  the  truncation  point. 

Let  Ai^  denote  the  events  of  accepting  hypotheses  at 

trial  n,  i=  0,1,2  and  Cn  the  event  of  continuing  to  trial  n+1 . 

(Note:  P(C_)=1,  P (C  )=0.)  There  will  be  an  OC  function  asso- 

0 n0 

ciated  with  each  of  the  three  hypotheses  giving  the  probability 
of  accepting  H^  under  a specified  state  of  nature  P^i*  Eac’h 
point  in  the  sample  space  can  again  be  denoted  (x,n.  ,n  . ,n) . 

Each  of  these  points  is  a member  of  one  of  the  above-mentioned 
sets,  that  is. 


A1  = 
n 

{ (x^  , n ^n) 

|x<cL(ni  ,n  1,n) 

and 

x<d  (n  , n 

X • ■ 

1 , n) 

AO  = 
n 

{ (x^  ,n  1#n) 

|x>cu  (Hi  , n ^n) 

and 

xid  (n.  , n 

L • « 

/n) 

t 

A2  = 
n 

{ (x^  , n l ,n) 

|x>c(J(n1  , n ^n) 

and 

x>du(n1  , n . 

1 ,n) 

or  the  continuation  region,  C . 

’ n 
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Again,  it  is  necessary  to  find  the  probability  of  leaching 
each  point  in  the  sample  space  under  the  specified  sequential 
test  rules  and  different  states  of  nature;  that  is,  P (x,n.  ,n  n) 

O X • t X 

Using  the  same  general  procedure  outlined  in  the  last 
section,  these  probabilities  are  found  recursively  using  the 
following  formula 

PS(x'nl.'n.l'*Pl.'P.l'Pll)  = (3-42) 

I(x-l,n1  -1 , n 1-l,n-l)Ps(x-l,n1  -l,n  1~l,n-l;p1  ,p  j/PiJPn 

+ I(x,n1  -1 , n ! ,n-l)  Pg  (x,  nL  -l,n  ^n-l.-p.^  ,p  i , Pj.  i ) (Pj  “pn) 

+ I(x,n1  ,n  j^-l^-DPg  (x,n1  ,n  1 -1 , n- 1 ; px  ,p  1,p11)(p  2 -PL  x ) 
+I(x,nli,n(1,n-l)Ps(x,nL(n1)n-l;pli,p>1,p11)(l-p1  -p  j+p^) 


where 


PS(x'nl.'n.l'°!pl.'p.l-pll)= 


1 if  x-n  =n  =0 

X • • X 

0 otherwise 


and  I (x,n.  ,n  n ,n-l)= 

X • • X 


0 if  (x,n  . ,n  , ,n-l) f C 

• X ■ I.  n 

1 otherwise 


Here  the  indicator  function  I accounts  for  the  fact  that  the  test 
terminates  when  the  test  statistic  leaves  the  continuation  region. 
The  simplification  for  computation  of  these  probabilities  given  in 
the  last  section  is  also  applicable  here. 

The  probability  of  each  of  the  events  Ai^,  i-0,1,2  is  computed 
for  each  trial  n=l , 2 , . . . , n^ . This  is  done  as  follows 
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P(  Ain/P11)“ 


nn 

nn 

IU 

1° 

ni.  0 

n , =0 

x^l  Ji(x-ni.'n.1'">ps(x’ni.'n.1'n;pi. 

' p. 1 ' P1 1 J 

where  J . = 1 

i 

1 if  (x,n.  ,n  . ,n)f  Ai 
l . . i n 

0 otherwise 

(3.43) 

and  IL=MAX(0,n^  +n  ^-n) 
IU=MIN(n1  , n x> 


The  probability  mass  function  of  the  DSN  can  be  expressed  as 

2 2 

‘i=0"An'_i=0l  '"‘n'*'!!' 


P(n;p11)-P(4yftAiw)-4SftP(Ain;p11) 


(3.44) 


and  is  computed  for  n=l , 2 , . . . , n^ . The  ASN  function  is  then 


asn (px1 ) =nI1nP (n;pxl) 


(3.45) 


Other  moments  can  similarly  be  expressed  as  in  (3.37). 

tH 

The  OC  function  of  the  i hypothesis  gives  the  probability 
of  accepting  that  hypothesis  as  a function  of  the  true  state  of 
nature  and  is  computed  as 

no 

0Ci(pll)=n=lP(Ain,Pll)  (3.46) 

The  true  a and  6 error  probabilities  for  each  SPRT  are  found  as 

“i=oci(po)  Broc0<pi> 

(3.47) 

a'=OC2(p0) 


The  above  properties,  along  with  the  probability  of  continuation 
to  trial  ng,  are  computed  by  the  computer  program  listed  in  the 
Appendix. 
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For  the  numerical  example  concerning  the  three  decision 
test  given  at  the  end  of  Section  3.4,  the  hypotheses  being  tested 
are 

H^:  p=p^=0.10 

versus  Hq : p=Pg=0.25  (3.47) 

versus  H2:  p=p2=0.40 

with  desired  error  probabilities  a^=a2=0.05  and  B^=32=0.1. 

The  exact  test  properties  for  this  example  are  given  in  Table 
3.7a.  The  OC  and  ASN  functions  are  graphed  in  Figure  3.8. 

Table  3.7b  shows  the  test  properties  for  the  same  sequential 
test  region,  using  the  same  truncation  modification  described 
in  Section  3.5. 


n 

i 

i Table  3.7a 

, j Test  Properties  for  the 

Three  Decision  '•'xample 


pl. 

P.l 

pll 

P(H0) 

P(H2) 

ASN 

P(C  , 

'V1 

0.5 

0.5 

0.05Q0 

0.999U1 

0.00099 

0.00000 

9.60 

0,00436 

0,04395 

0.5 

0,5 

0,0800 

0.90367 

0.01632 

0.00000 

12.28 

0.5 

0.5 

0.1000 

0. 90501 

0.05497 

0 . 00002 

14.11 

0,10509 

0.5 

0.5 

0,1200 

0.80642 

0.13350 

0.00007 

15.81 

0,18249 

0.27269 

0.5 

0.5 

0.1500 

0.64960 

0.32974 

O'.  00045 

17.56 

0.5 

0.5 

0.1600 

0.42817 

0.56934 

0.00246 

16,06 

0,27869 

0.5 

0.5 

0,2000 

0.20224 

0.71071 

0.00704 

17.8/ 

0,24215 

0.5 

0.5 

0.2300 

0.124V6 

0.84690 

0.02814 

17.41 

0,16001 

0.16872 

0.5 

0.5 

0,2400 

0.09038 

0.86727 

0.04234 

17.33 

0.5 

0.5 

0,2500 

0.06365 

0,67433 

0 . 06201 

17.30 

0,16519 

0.5 

0.5 

0.2600 

0.00364 

0.66797 

0.06636 

17.35 

0,16991 

0.5 

0.5 

0,2700 

0.02913 

0 ,84927 

0.12259 

17.45 

0,18238 

0.5 

0.5 

0.3000 

0.00700 

0,71349 

0.27911 

17.98 

0,24781 

0.5 

0.5 

0,3200 

0.00262 

0.57233 

0 .42504 

16.22 

0.26613 

0.5 

0.5 

0,3500 

0.00047 

0.33201 

0.66751 

17.79 

0,26057 

0.5 

0.5 

0.3800 

0.00007 

0.13455 

0.B6537 

16.07 

0.16795 

0.5 

0.5 

0,4000 

0.06002 

0.05541 

0.94457 

14.35 

0,10836 

0.5 

0.5 

0,4200 

0 . ooouo 

0.01645 

0.98J55 

lc.47 

0,04537 

0.5 

0.5 

0.4500 

o.opooo 

0.00099 

0 .99900 

9.89 

0,00451 

Table  3. 

,7b 

Test 

Properties  for  the 

Three  Decs ion 

Example 

(Favoring  HQ) 

Pl. 

p.l 

pll 

PU^) 

i,oy 

p(h2) 

ASN 

P(C 

"(T1 

0.5 

0.5 

0,0500 

0.99488 

0.00512 

O'.OOOOQ 

9.80 

0,00436 

0.5 

0.5 

0.0800 

0.9*521 

0 . 05478 

0.00000 

12.28 

0,04395 

0.5 

0.5 

0,1000 

0.8*923 

0.14074 

0.00002 

14.11 

0,10509 

0.5 

0.5 

0.1200 

0.72928 

0.27065 

0.00007 

15.81 

0,18249 

0.5 

0.5 

0.1500 

0.492V6 

0.50665 

0.00039 

17,56 

0.27289 

0.5 

0.5 

0,1800 

0.27813 

0.72005 

0.00181 

18,06 

0,27889 

0.5 

0.5 

0,2000 

0.17198 

0 . 82344 

0.00458 

17,87 

0,24215 

0.5 

0.5 

0,2300 

0.07235 

0.91144 

0.01621 

17.41 

0,16001 

0.5 

0.5 

0,2400 

0.0*220 

0 . 92393 

0.02386 

17.33 

0,16872 

0.5 

0.5 

0,2500 

0.036?7 

0.92851 

0.03451 

17.30 

0,16519 

0.5 

0.5 

0,2600 

0.0?57l 

0.92527 

0.04901 

17.35 

0,1699i 

0.5 

0.5 

0,2700 

0,01755 

0.91409 

0 .06835 

17.45 

0.18238 

0.5 

0.5 

0,3000 

0.00500 

0.82962 

0.16537 

17.98 

0.24781 

0.5 

0.5 

0,3200 

0.00177 

0.72780 

0.27022 

18.22 

0 . 28613 

0.5 

0.5 

0.3500 

0.00042 

0.51463 

0 .48494 

17.79 

0,28057 

0.5 

0.5 

0,3600 

0.00007 

0.27622 

0.72371 

16.07 

0,18795 

0.5 

0.5 

0.4000 

0.00002 

0.14405 

0.85593 

14.35 

0 .10836 

0.5 

0.5 

0,4200 

0.00000 

0.05621 

0.94378 

12.47 

0,04537 

0.5 

0.5 

0,4500 

0.00000 

0.00527 

0.99473 

9.89 

0,00451 
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Figure  3.8  Graphs  of  the  OC  and  ASN  Functions  for  the 
Three  Decision  Exanple 


CHAPTER  4 

SEQUENTIAL  TESTS  WHEN  THE  MARGINAL 
PROBABILITIES  ARF  UNKNOWN 


4.0  INTRODUCTION 


This  chapter  treats  sequential  methods  for  testing  2x2 
contingency  tables  when  the  marginal  probabilities  are  unknown. 
Section  4.1  discusses  these  tables  and  the  hypothesis  being 
tested.  Also  introduced  is  the  cross  product  ratio,  the  param- 
eter on  which  the  sequential  tests  are  based.  Section  4.2 
examines  Fisher's  exact  test  for  2x2  tables  with  small  samples, 
along  with  the  related  "extended  hypergeometric  distribution." 
Section  4.3  develops  the  theory  for  the  construction  of  the 
sequential  test  regions  for  both  two  and  three  decision  test 
procedures.  The  last  section  shows  how  the  exact  properties  of 
these  regions  can  be  determined.  Numerical  examples  are  also 
given . 


4.1  THE  HYPOTHESIS  BEING  TESTED  AND  THE  CROSS  PRODUCT  RATIO 


The  underlying  probability  model  for  the  2x2  contingency 
table  treated  here  is  the  same  as  that  given  in  Figure  3.1, 
except  that  in  the  case  considered  here,  the  marginal  proba- 
bilities p and  p 1 are  assumed  to  be  unknown.  This  is  the 
case  termed  the  "double  dichotomy"  by  Barnard  (1.947a)  and  dis- 
cussed in  Section  1.3.  The  hypothesis  being  tested  is  for 
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independence  or  for  some  specified  degree  of  dependence  between 
the  two  marginal  distributions.  As  indicated  in  Section  3.2, 
this  can  be  expressed  in  terms  of  several  different  parameters. 
The  most  convenient  parameter  to  use  for  the  present  case  is 
the  cross  product  ratio  (CPR) 

p U-p  -p  1+p11) 

t=  (4.1) 

(P1.“P11) *P.l"Pll* 

The  cross  product  ratio  has  a long  history  in  the  analysis 
of  contingency  table  data  for  which  it  has  been  used  as  a measure 
of  association.  When  t=l,  the  two  marginal  distributions  are 
independent.  For  t>l  there  is  negative  dependence,  and  for  t<l, 
there  is  positive  dependence  between  the  marginal  distributions. 
The  hypotheses  for  tests  of  independence  car.  be  expressed  as 

Ho!  t=to=1 

(4.2) 

versus  : t=t^l 

The  cross  product  ratio  is  only  one  of  many  measures 

of  association  which  have  been  proposed.  The  papers  of  Goodman 

and  Kruskal  (1954,  1959,  1963  and  1971)  discuss  many  of  these. 

2 

Some  are  functions  of  the  x statistic;  others  are  functions 
of  a difference  of  probabilities  or  of  ratios  of  probabilities. 
Most  authors,  however,  agree  that  the  cross  product  ratio, 
as  a measure  of  association,  has  most  of  the  desirable  charac- 
teristics, certainly  more  than  most  other  measures  which  have 
been  proposed  for  use  with  2x2  tables.  This  point  is  made,  for 
example,  by  Fleiss  (1973)  and  Edwards  (1963);  the  latter  asserts 
that  the  measure  of  association  in  a 2x2  contingency  "should 
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logically  be  some  function  of  the  cross-ratio."  Fleiss  also 
mentions  some  criticism  of  the  cross  product  ratio,  first 
pointed  out  by  Berkson  (1958).  That  is,  the  level  of  each  rate 
is  lost  in  computing  the  ratio  ; this,  however  is  true  for 
almost  all  measures  of  association. 

It  seems  that  the  CPR  first  appeared  as  the  parameter  of 
interest  in  Fisher's  exact  test  (Fisher,  1935)  for  2x2  tables, 
as  discussed  in  the  next  section.  Wald  uses  the  closely  related 
odds  ratio  for  comparing  two  unknown  binomial  properties.  The 
odds  ratio  between  two  binomial  probabilities  is 


Pi  U-P2) 
t=  Pjd-Pj) 


(4.3) 


Such  tests  are  discussed  in  the  next  chapter.  The  odds  ratio  is 
also  the  parameter  which  is  used  to  specify  the  hypotheses  in 
Girshick's  sequential  two  sample  tests  for  Darmois-Koopman  type 
populations  (Girshick,  1946).  Contours  for  the  odds  ratio  with 
respect  to  p^  and  p2  are  shown  in  Figure  4.1. 

Cornfield  (1956b)  uses  the  cross  product  ratio  in  retro- 
spective studies.  Fleiss  (1973)  discusses  this  and  further  ex- 
plains the  invariance  of  the  measure  to  different  types  of  studies. 
This  type  of  invariance  is  an  important  advantage  of  the  CPR. 

That  is,  if  researchers  are  studying  a phenomenon  using  different 
methods  (e.g.,  retrospective  versus  prospective  studies)  the 
measure  of  association  being  studied  will,  on  the  average,  be  the 
same  for  the  different  studies.  Also,  the  odds  ratio  is  the 
natural  parameter  of  association  when  a logistic  model  is  used . 


Figure 
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The  logistic  form  is  treated  by  Cox  (1958)  and  Gart  (1971),  and 
is  briefly  discussed  in  the  next  chapter. 

Estimates  and  confidence  limits  for  the  CPR  and  odds  ratio 
can  also  be  found.  Methods  for  doing  this  are  given,  for  example, 
by  Fisher  (1962),  Goodman  (1964)  and  Harkness  (1959).  A computer 
algorithm  for  finding  such  estimates  and  confidence  limits  is 
given  by  Thomas  (1971).  Sequential  tests  of  hypotheses  concerning 
this  parameter  are  treated  in  this  chapter. 

Because  inferences  are  to  be  made  on  the  cross  product  ratio 
or  the  odds  ratio,  rather  than  the  actual  probabilities  in  the 
table,  the  marginal  probabilities  are  so-called  nuisance  param- 
eters. That  is,  their  values  give  no  information  concerning  the 
inferences  to  be  made,  but  they  do  affect  the  overall  power  of 
the  procedures  used. 

The  following  is  a justification  for  the  use  of  the  cross 
product  ratio  when  making  comparisons  between  probabilities. 

This  short  discussion  concerns  the  comparison  of  two  unknown 
binomial  proportions;  the  ideas  presented,  however,  are  useful 
when  testing  for  independence  in  the  2x2  contingency  tables  con- 
sidered here.  When  comparing  two  binomial  probabilities,  one 
might  consider  using  the  difference  between  the  probabilities 

A=Pl-P2 

to  measure  the  degree  of  inequality.  This  is  a rather  poor 
measure,  however,  because  the  importance  of  a given  value  of  A 
depends  on  the  actual  magnitudes  of  p^  and  p2 . For  example,  the 
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with  small  samples.  This  fixed  size  test  is  developed  and  dis- 
cussed here.  The  test  is  to  be  used  with  the  probability  model 
shown  in  Figure  3.1,  with  unknown  marginal  probabilities  p^ 
and  p ^ . The  probability  of  observing  the  2x2  table  shown  in 
Figure  3.2  is  then  the  multinomial  distribution 


pF,x'ni.'n.i;"'pi.'P.i'pii)= 


(4.5) 


n.  -x  n . -x  n-n1  -n  . +x 

n!  P11(P1.‘P.1)  (P.1_P11)  (1_P1._P.1+P11) 


. 1 **11' 


x!  (n^  -x) ! (n  ^-x) ! (n-n^  -n  ^ + x) ! 


The  hypothesis  of  independence  to  be  tested  is  expressed 


in  terms  of  the  cross  product  ratio 


pn  (1~pi.~p.itpn) 
<pi.-pn)  (p.i-pii> 


(4.6) 


When  t=l,  the  hypothesis  of  independence  is  true.  As  the  param- 
eters p,  and  p , are  unknown,  they  are  nuisance  parameters  having 
no  direct  bearing  on  the  degree  of  association. 

Thus,  Fisher's  exact  test  is  conditional  on  the  observed 
marginal  totals.  The  conditional  distribution  is  independent 
of  these  nuisance  parameters.  The  probability  of  observing  the 
sample  table  shown  in  Figures  3.2,  conditioned  on  the  observed 
marginal  totals,  n^  and  n ^ is  then  easily  shown  to  be 


Pc(x;n1  , n , n , t ) = 


we;;)  .■ 


(4.7) 
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where  IL=MAX(0,n.  +n  ,-n) 

X • • X 

IU=MIN(n  , n ,) 

X • • X 

and  t is  the  cross  product  ratio.  For  the  case  of  independence, 
when  t=l,  (4.7)  reduces  to 

1. 

( 

This  is  simply  the  hypergeometric  distribution  for  which  tables 
of  the  probability  mass  and  cumulative  distribution  functions  are 
given  by  Lieberman  and  Owen  (1961) . 

Fisher's  exact  test  for  independence  is  conducted  by 
choosing  as  the  critical  region  (for  each  of  the  different  com- 
binations of  n.  and  n . ) those  values  of  x which  have  the  smallest 

X • • X 

probabilities  (in  one  or  both  tails  of  the  conditional  distribu- 
tion) summing  to  the  desired  significance  level  under  the  null 
distribution  in  (4.8).  Tables  for  such  tests  are  given,  for 
example,  by  Armsen  (1955)  and  Owen  (1962). 

As  mentioned  earlier,  there  have  been  some  arguments  with 
this  approach.  The  controversy  arises  because  the  test  is  con- 
ditioned on  the  observed  margins,  greatly  reducing  the  reference 
set  from  which  the  critical  region  is  chosen.  Fisher's  argument 
(Fisher,  1935)  in  favor  of  this  approach  is  based  on  the  theory 
of  sufficient  and  ancillary  statistics.  Because  n,  and  n 

X • • X 

provide  no  information  about  the  degree  of  dependence  (i.e.,  t) 
they  are  ancillary  statistics.  Ancillary  statistics  do,  however, 


Pc(x,n1  , n ^ , n , 1 ) = 


: 
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indicate  the  amount  of  information  concerning  the  degree  of 
dependence  which  is  available  from  the  sample.  Inferences 
about  t,  the  CPR,  should  therefore  be  made  conditional  on  the 
ancillary  statistics.  Lehmann  (1959)  shows  that  the  uniformly 
most  powerful  unbiased  tests  of  hypotheses  concerning  t must  be 
based  on  the  conditional  distribution  of  x given  (n^  ,n  ^). 

This  argument  is  given  a more  rigorous  treatment  in  Section  9.2 
where  the  problem  is  presented  in  the  logistic  form. 

The  distribution  in  (4.7)  is  known  as  the  "extended  hyper- 
geometric distribution."  This  distribution  gives  the  probability 
of  observing  a given  2x2  contingency  table,  conditional  on  the 
observed  margins,  for  any  value  of  t,  the  CPR.  Harkness  (1969) 
discusses  this  distribution  and  its  properties  in  detail. 

While  the  conditional  distribution  in  (4.7)  is  useful  for 
testing  hypotheses  about  t,  the  unconditional  multinomial  dis- 
tribution in  (4.5)  must  be  used  to  find  the  power  of  the  test. 
Harkness  (1959)  and  Harkness  and  Katz  (1964)  treat  the  power  of 
the  uniformly  most  powerful  unbiased  test  (UMPUT)  discussed,  for 
example,  by  Lehmann  (1959).  They  also  compare  the  power  function 
of  the  different  2x2  table  models  outlined  in  Section  1.3.  The 
power  of  the  UMPUT  test  is  compared  with  sequential  tests  presented 
later.  Following  Lehmann  (1959),  the  UMPUT  of  size  <t  tor 

H0:  t=t0 

U (4.9) 

versus  H^ : t/ 

is 
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i 

I 

. J 

1 if  x<c^  (n^  ,n  ^)  or  x^c^n^  ,n  j) 

♦(nl.'n.i'x>'  Y1  if  x=ct(nl.n.l)'i=1'2  (4.10) 

0 if  c^fn^  »n  i^<x<c2^ni  'n 

where  and  y ^ are  values  satisfying  the  equations 

E(4»(n1  ,n  1,x))=  aE(xiJj(n1  ,n  1#x))=  otE(x)  (4.11) 

and  the  expectations  are  taken  with  respect  to  the  null  distribu- 
tion, that  is,  the  hypergeometric  in  (4.8).  This  is  a randomized 
version  of  Fisher's  test  enabling  the  probability  of  a Type  I 
error  to  be  exactly  a.  This  test  is  compared  with  the  sequential 
test  in  Section  4.4. 

In  the  examination  of  the  power  function  of  the  UMPUT  given 
by  Harkness  (1959),  it  is  important  to  note  that  the  a error  in 
all  cases  has  a value  of  0.05.  That  is,  the  probability  of  re- 
jecting Hq  when  t=l  is  0.05.  The  power,  however,  varies  consid- 
erably over  equal  values  of  t^l,  depending  on  the  values  of  the 
nuisance  parameters  p1  and  p . . Thus  the  power  (with  respect 
to  t)  of  the  test  is  dependent  on  these  nuisance  parameters.  The 
power  is  greatest  when  p..  and  p . are  near  0.5.  The  reduction 

X • • X 

of  power  for  the  more  extreme  values  of  p1  and  p . will  also 
occur  to  a lesser  extent  in  the  truncated  sequential  test  devel- 
oped here.  This  will  be  discussed  further  with  the  examination 
of  the  exact  test  properties  here  and  in  Chapters  5 and  7. 
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4.3  THEORY  FOR  SEQUENTIAL  TESTS  WITH  TWO  AND  THREE  DECISIONS 


This  section  develops  the  theory  for  sequentially  testing 
the  hypothesis  of  independence  of  2x2  contingency  tables.  It 
is  assumed  that  both  marginal  totals  are  random  variables  with 
unknown  probability  distributions.  The  tests  are  based  on  the 
extended  hypergeometric  distribution  and  the  minimal  sufficient 
statistic  (x,n.  ,n  . ,n)  from  the  table  in  Figure  3.2.  The  under- 

1 • • X 

lying  probability  model  is  the  same  as  shown  in  Figure  3.1,  with 
p..  and  p now  assumed  unknown. 

X • • X 

To  test  the  hypothesis 


H 

versus  H 


0: 

Is 


t=t. 


t=Vfc0 


(4.12) 


a Wald-type  SPRT  can  be  constructed  by  using  the  ratio 

P (x, n.  , n . ,n,t. ) 

Ln./Ln.  = — — -Xr- 

1 0 Pc(x,n1  , n 1,n,tQ) 

where  pc  ( • ) is  the  conditional  distribution  in  (4.7). 
for  the  sequential  test  procedure  are  then  to 


(4.13) 

The  rules 


accept  Hq  if  fcn (Ln^/LnQ ) <b 

accept  if  £n (Ln^/Ln^) >a . 


(4.14) 


Otherwise  the  test  is  continued  and  another  sample  is  taken. 
Here  a and  b are  again  approximated  by  the  values 


a ~Stn  (A)=S,n  (8/  ( 1 — <» ) ) 
b -£n  (B)=£n  ( ( 1 — (3 ) /nt ) 


(4.15) 


The  ratio  in  (4.13)  does  not  represent  a likelihood  ratio 
in  the  true  sense  of  the  word;  it  is  a probability  ratio,  con- 
ditional on  the  observed  values  of  the  ancillary  statistics. 

The  values  of  t^  and  t^  to  be  used  for  the  test  can  be  chosen 
with  the  aid  of  Figure  4.1.  Using  the  argument  of  ancillary 
statistics  put  forward  by  Fisher,  the  ratio  in  (4.13)  is  a 
logical  method  of  determining  critical  values  for  the  sequential 
tests  presented  here. 

Paulson  (1970)  suggests  a conditional  sequential  test,  for 
two  sample  problems  of  the  Darmoi s-Koopman  form,  which  is  con- 
ditional on  an  ancillary  statistic.  Me  rejects  the  formulation, 
however,  because  the  test  properties  are  "difficult  to  deter- 
mine." He  then  suggests  a test  based  on  the  ratio  of  moment  gen- 
erating functions  which  would  be  guaranteed  to  meet  the  specified 
error  probabilities.  By  using  the  direct  method  of  sequential 
analysis,  however,  one  can  find  the  exact  properties  of  any  such 
sequential  tests,  as  shown  below. 

Although  the  individual  critical  values  will  in  general 
be  different,  the  sequential  test  regions  will  take  on  the  same 
form  as  the  tests  presented  for  the  case  of  known  marginal  prob- 
abilities treated  in  Chapter  3.  At  each  trial  n-l,2,...nQ,  there 
are  again  two  critical  values  for  x,  c (n.  ,n  .,n)  and  c (n.  ,n  ,,n), 

Ll  1 • • J.  U X a a X 

2 

for  each  of  the  (n+1)  different  combinations  of  the  marginal  totals. 

The  critical  values  c (n.  ,n  -,n)  and  c (n.  ,n  .,n)  have  the  same 

Xj  X a a X U X a a X 

meaning  here  as  illustrated  by  the  sequential  test  rules  shown  in 
(3.16).  The  critical  values  for  the  present  case  are  found  by 
inverting  the  log  likelihood  ratio  equations 

| 
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b=g(x/n1  , n 1 , n , tQ , ) = in (Ln1/LnQ ) 

a=g  (x,n^  ,n  1,n/tQ,t1)  = fcn  (Lr^/Lng) 


(4.16) 


again  by  solving  for  x.  These  values  can  be  expressed  as 


(n^  , n ^,n)=  £g  1(b,n1  ,n  1»n,tn, 

(b+F(tQ)-F(t1)  )/Un  (t1)-in  (tQ)  ) J 


(4.17) 


-1 


and 


M=[K]  is  the  greatest  integer  less  than  or  equal  to  K. 

The  sequential  test  region  defined  by  these  critical  limits 
is  used  in  the  same  manner  as  the  regions  discussed  in  Section 
3.3.  A numerical  example  of  the  above  procedure-  follows.  It 
is  desired  to  test  the  hypothesis 


(4.18) 

versus  : t=t^=9 

with  desired  error  probabilities  u=0.1  and  3=0.25.  The  test  is 
truncated  at  trial  25.  The  critical  limits  for  this  test,  which 
are  shown  in  Tables  4.1a  and  4.1b,  were  computed  using  the  computer 
program  for  such  tests  which  is  listed  in  the  Appendix.  The 
limits  for  trials  1-10  are  shown  in  Table  4.1a  and  Table  4»i.b 
gives  the  limits  fox  trial  25,  the  truncation  point.  The  test 
procedure  for  the  present  case  is  exactly  the  same  as  explained 
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at  the  end  of  Section  3.3,  for  the  case  when  the  marginal  proba- 
bilities are  known. 

The  construction  of  the  sequential  test  regions  for  three 
decision  test  procedure  is  analogous  to  the  development  in 


Section  3 

.4. 

In  this  case,  however, 

the  three  hypotheses  are 

specif ied 

as 

Hls 

t=ti<fco 

versus 

Ho: 

t=to 

(4.19) 

versus 

H2: 

t=t2>t0 

In  addition,  the  desired  a and  B errors,  u , and 

B2,  are  specified  as  before.  Two  log  likelihood  ratios  are 
then  constructed  as 


£n (Ln^/Ln^ ) =g (x , n ^ ,n  x , n , t x , t Q ) 

(4.20) 

£n (Ln2/LnQ ) =g (x , n^  ,n  1,n,tQ,t2) 
where  g(-)  is  the  same  as  (4.16)  and  the  test  procedure  rules 
are  the  same  as  the  ones  shown  in  (3.25),  giving  rise  to  two  sets 
of  critical  values,  one  each  for  the  first  and  last  pair  of 
hypotheses  in  (4.19). 

As  a numerical  example,  consider  the  hypotheses 
Hx:  t=t1=0.1111 

versus  Hq : t=tQ=1.0  (4.21) 

versus  H2:  t=t2=9.0 
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and  ai=a2=0.1  and  B^=82=0*2*  and  3^  are  again  interchanged 

because  t^<tg.  The  limits  for  the  second  pair  of  hypotheses  are 
the  same  as  those  shown  in  Tables  4.1a  and  b.  The  critical  limits 
for  the  first  pair,  up  to  trial  10,  are  shown  in  Table  4.2. 

The  exact  values  for  the  properties  of  regions  for  both  the  two 
and  three  decision  test  procedures  are  found  in  the  next  section 
by  using  the  direct  method  of  sequential  analysis. 

4.4  EVALUATION  OF  THE  SEQUENTIAL  TEST  REGIONS 

This  section  describes  the  evaluation  of  the  sequential  test, 
regions  for  a 2x2  contingency  table  when  the  marginal  probabilities 
are  unknown.  The  regions  developed  in  the  last  section  are  eval- 
uated here  as  a numerical  example. 

The  method  of  finding  the  exact  properties  of  the  sequential 
test  regions  for  the  present  model  is  essentially  the  same  as  the 
procedure  used  for  the  2x2  contingency  table  with  known  marginal 
probabilities,  treated  in  Section  3.5.  This  is  due  to  the  same 
underlying  multinomial  distribution.  Because  the  marginal  proba- 
bilities are  unknown  in  the  present  case,  they  must  be  specified 
as  part  of  the  state  of  nature.  This  means  that  the  OC  function, 
the  ASN  function  and  the  distribution  of  the  DSN  will  be  functions 
of  three  parameters.  These  can  be  specified  in  a number  of  ways. 
Because  the  sequential  test  is  based  on  the  cross  product  ratio, 
the  state  of  nature  is  specified  here  by  p^  ,p  ^ and  the  cross 
product  ratio 

pn(1~pi.'p.itpiil 

(pi.-pn)(p.rpn) 


t= 


(4.22) 
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The  procedure  for  determining  the  sequential  test  properties 
which  is  described  in  Section  3.6  is  used  here  with  one  modifi- 
cation. As  explained  above,  the  state  of  nature  will  be  specified 
by  (p  ,p  .,t).  Because  the  state  of  nature  must  be  specified  in 
three  dimensions,  the  test  properties  can  be  expressed  in  a graph 
only  if  two  of  the  parameters  are  held  constant.  A contour  plot 
can  be  used  if  one  of  the  parameters  is  held  constant.  Tables  of 
the  important  test  properties,  however,  are  given  below. 

For  the  two  decision  example  given  in  Section  4.3,  the 
truncated  sequential  test  for 


V t=to=1 


versus  : t=t1=9 


(4.23) 


and  a=0.1  and  3=0.25  is  evaluated  for  p =.1(.1).5,  p ^.K.Dp. 
and  t=l(2)9  (other  values  being  unnecessary  because  of  symmetry). 
The  same  values  of  the  state  of  nature  are  used  to  evaluate  the 
three  decision  example  given  in  Section  4.3  to  test  the  hypothesis 


Hl:  t=t1  = o.iin 


versus  HQ:  t=tQ=l 


(4.24) 


versus  Hjt  t=t2=9 


with  (*1=012=0.1  and  Bi=B2=0.25. 

Both  the  OC  and  the  ASN  functions  are  given  for  these  examples 


in  Tables  4.3  and  4.4  for  the  two  and  three  decision  examples 
respectively. 
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Tent  I'roport  lou  for  the 
Two  Decision  Tent  Ex«»wpl»- 


Pi.  p. 

1 pll 

t 

k 

P(H0) 

POlj) 

ASN 

He 

nO~ 1 

0.1  0.1 

0.0100 

i.ooo 

1,00 

0.97034 

0.12961 

21.24 

0,65266 

0.1  0.1 

0.0220 

3.009 

2,20 

0,49214 

0.30,6ft 

22.00 

0.71927 

0.1  0.1 

0.0100 

9.009 

3.00 

0.54063 

0.4194/ 

22.16 

0, 72657 

0.1  0.1 

0 i 0190 

7.009 

1.50 

0.50462 

0 , 4 7 V 4 6 

22.12 

0.71714 

0.1  0.1 

0,0100 

9,009 

1.9ft 

0,44961 

O.i'.uld 

22.01 

0,70267 

0.2  0.1 

0.0200 

1,009 

1.0ft 

0,86467 

0 , 1 31,32 

18.34 

0,46253 

0-2  0.1 

0.0190 

3.  J09 

1,95 

0.64836 

V.  35163 

19.97 

0.57040 

0.2  0.1 

0,0900 

9,009 

2,50 

0.51625 

0 . 4 6 J 7 4 

23.32 

0.581 JB 

0.2  0.1 

0.0970 

7.009 

2,66 

0.41071 

0 .56v2b 

20.34 

0.56970 

0.2  0.1 

0.0420 

9.009 

3.13 

0.37154 

0.6?i345 

20.25 

0.55270 

0.2  0.2 

0,0400 

1.009 

1.00 

0,67970 

0.12u2» 

14.50 

0.23948 

0.2  0.2 

0.0H0 

3.009 

1,63 

0.61162 

0, 381,17 

16.86 

0.35606 

0.2  0.2 

0.0090 

9.009 

2.22 

0.44968 

0. 55031 

17.21 

0.35962 

0.2  0.2 

0,1000 

7,000 

2.50 

0,34722 

0.65. 78 

17.10 

0.33709 

0.2  0.2- 

0.1000 

9.009 

2.70 

0.27909 

0.72090 

16.85 

0.31116 

0.3  0.1 

0.0100 

1.009 

1.00 

0,45047 

0.14912 

16.77 

0.39245 

0.1  0.1 

0.0930 

1.009 

1,77 

0,61452 

0,38547 

19.17 

0,53063 

0.1  0.1 

0.0640 

9.009 

2.13 

0,47772 

0,52027 

19.81 

0.55240 

0.1  o.t 

0.0710 

7,009 

2,37 

0,39636 

0.60362 

20.01 

0.54676 

o.l  0.1 

0,0790 

9.009 

2.50 

0,34044 

0,65956 

20.07 

0.53661 

0.1  0.2 

0.0600 

1.009 

l .on 

0,66417 

0,11543 

12.78 

0.17761 

0.1  0.2 

0.1000 

3.009 

1,67 

0.60035 

0.39964 

15.59 

0.29536 

0.1  0.2 

0.1190 

9,009 

1,98 

0.42962 

0 , 5 7 j3  7 

16.04 

0,29513 

0.1  0.2 

0.1110 

7.009 

2,19 

0,32641 

0.67356 

15.96 

0.27249 

0.1  0.2 

0,1190 

9,009 

2,32 

0.25953 

0.74047 

15.75 

0.24779 

0.1  0.1 

0,0900 

1.000 

1,00 

0,69764 

0.10235 

10.92 

0,10730 

0.1  0.1 

0.1410 

1,009 

1.57 

0,59686 

0.40313 

13.82 

0.20413 

0.19828 

0.1  0.1 

0.1640 

9.000 

1.62 

0.41426 

0.50573 

14.17 

0.1  0.1 

5,1790 

7.000 

1.99 

0.30629 

0.69371 

13.99 

0.17374 

0.1  0.1 

0.1090 

9.009 

2.10 

0.23791 

0.76206 

13.68 

0.14952 

0.4  0.1 

0.0400 

1.000 

1.00 

0.M447 

0.14152 

16.23 

0.36027 

0.4  0.1 

0.0640 

3.000 

1.60 

0.54767 

0 . 4 J<33 

19.24 

0,54997 

0.4  0.1 

0,0740 

9.000 

1.46 

0.43661 

0.56036 

20.16 

0.549J1 

0.4  0.1 

0.0790 

7.000 

1.97 

0.15900 

0.64099 

20.55 

0.59899 

0.4  0.1 

0.0010 

9. COO 

2.07 

0.10814 

0.69145 

20.74 

0.40011 

0.4  0.2 

0.0000 

i.ooo 

1,00 

0.17750 

0.12/50 

12.27 

0.17214 

0.4  0.2 

0,1210 

1.000 

1.54 

0.5024] 

0.41757 

15.69 

0.2*740 

0.4  0.2 

0.1410 

9,009 

1,76 

0,41274 

0.50/21 

16.14 

0.10122 

0.4  0.2 

0.1920 

7.090 

1,90 

0.11300 

0.64/00 

16.22 

0,28274 

0.4  0.2 

0.1990 

9.009 

1,99 

0.24929 

0.75u71 

16.14 

0,26198 

0.4  0.1 

0.1200 

1,099 

1,00 

0.49497 

0.10102 

10.26 

0.0*047 

0.4  0.1 

0.1760 

3.000 

1,47 

0.58941 

0.41019 

13.31 

0,14260 

0.4  0.3 

0.2000 

9,000 

1.67 

0.40547 

0.59453 

13.70 

0.1754* 

0.4  0.1 

0.2190 

7,009 

1.79 

0.29415 

0.70164 

13.96 

0.H272 

0.4  0.1 

0.2290 

9,000 

1,17 

0,23135 

0.76C64 

13.29 

0,13036 

0.4  0.4 

0-1600 

1.009 

1,00 

0,90448 

0.09551 

9.38 

0.04275 

0.4  0.4 

0.2230 

3.000 

1,39 

5,590(0 

0.40999 

12.34 

0.140*0 

0.4  0.4 

0.2900 

9,009 

1,56 

0.40133 

0.59666 

12.65 

0,13226 

0.4  0.4 

0.2670 

7.009 

1,67 

0,29274 

0.70725 

12.43 

0,1101* 

0.4  0.4 

0.2700 

9.000 

1,79 

0.22555 

0.77445 

12.10 

0.049*0 

0.0  0.1 

0.0900 

1.000 

1.00 

0.77770 

0.22229 

14.52 

0.41334 

0.9  0.1 

0.0730 

3.000 

1.46 

0.51859 

0.46140 

19.91 

0.41142 

0.9  0.1 

0.0010 

9.000 

1.62 

0.39571 

0.60427 

20.94 

0,64701 

0.9  0.1 

0.0060 

7.000 

1.72 

0.12569 

0.67430 

21.50 

0.60962 

0.9  0.1 

0.0900 

9.000 

1,76 

0.24067 

0.71932 

21.60 

0,70080 

0.9  0.2 

0.1000 

1.000 

1.00 

0.46100 

0 . 1 3o99 

12.98 

0.19941 

0.9  0.2 

0.1420 

1.000 

1.4? 

0,55415 

0.44145 

16.23 

0,344*6 

0.9  0.2 

0,1900 

9.009 

1,98 

0,19481 

0,6051V 

17.11 

0,35435 

0.9  0.2 

0.1470 

7.009 

1,67 

0.10101 

0.69699 

17.39 

0.34747 

0.9  0.2 

0.1720 

9,009 

1,72 

0.24162 

0,75836 

17.46 

0,33281 

0.9  0.1 

0.1900 

1.009 

1.00 

0.49125 

0.10675 

10.41 

0,1017* 

0.9  0.1 

0,2060 

3.00V 

1,37 

0.57308 

0. 42612 

13.73 

0,20200 

o.9  e.i 

0.2200 

9.009 

1,52 

0,39294 

0.60705 

14.26 

0,1*704 

0.9  0.1 

0.2«10 

7.009 

1.41 

0,28975 

0 , 71624 

14.26 

0.17514 

0.9  0.1 

0.2900 

9.009 

1,67 

0.22564 

0.77432 

14.11 

0,15405 

0.9  0.4 

0.2000 

1.000 

1.00 

0.90144 

0.09614 

9.29 

0,06204 

0.9  0.4 

0.2640 

1.009 

1,32 

0,54262 

0,41736 

12.33 

0.14036 

0.9  0.4 

0,2910 

9,000 

1,45 

0,39404 

0.60515 

12.69 

0.1H09 

0.9  0.4 

0.3070 

7.000 

1.53 

0,24766 

0,71213 

12.51 

0,11025 

0.9  0.4 

0.3100 

9.000 

1.59 

0.22199 

0.77601 

12.23 

0,07045 

0.9  0.9 

0.2900 

1.000 

1.00 

0.90402 

0.0951b 

6.95 

0.(5119 

0.9  0.9 

0.1170 

3,000 

1,27 

0,50635 

0.41365 

ll.*9 

0,12325 

0.9  0.9 

0,1490 

9,009 

1,38 

0.39607 

0.60312 

12.16 

0,11461 

0.9  0.9 

0,1430 

7. COO 

1.45 

0.28077 

0.7U22 

11.95 

0,09390 

0.9  0.9 

0.1790 

9.009 

1.50 

0.22230 

0.7776V 

11.62 

0,07510 
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pl.  p.l 

Pll 

t 

\ 

l (il  ) 

tt 

Mil,) 

Hll  ) 

Af.H 

HC  , 

0.1  0.1 

0.0100 

1,009 

1.03 

3.10910 

0.75646 

0,13138 

24,87 

0.97653 

0.1  0.1 

0,0220 

3,000 

2.2' 

0.3*664 

C .63 ,57 

0 ,31844 

2*. *0 

0,97 311 

0.1  0.1 

0,0300 

0.000 

3.01 

». 72'  ] 3 

C , 54. U 

0,43279 

2 .1 , 9 4 

0,671*5 

0.1  0.1 

0,0300 

7,000 

3.09 

0.31* 34 

6.4749. 

0,80971 

23,52 

0 , b/  759 

0.1  0.1 

0.0390 

9.009 

3.93 

9 . 31 ' 1 9 

0,42605 

0,864  76 

23,17 

0 . 79073 

0.2  0.1 

0,0200 

1 .009 

1 . 00 

6,24259 

0.0144/ 

0,1*794 

24,67 

0.94505 

0.2  0.1 

0,0390 

3.009 

1 . 94 

0.089/7 

0 . 53>( 9 

0,  3MC3 

2 3.79 

0.84673 

0.2  0.1 

0.0000 

0.000 

2.53 

0.0*622 

0 ,44686 

0.50719 

23.03 

0,77136 

0.2  0.1 

0.0070 

7,009 

2.84 

3.32-12 

0 . 3 7 0 3 6 

0.59752 

22.42 

0.71115 

0.2  0.1 

0,0620 

9,000 

3,10 

0.31««4 

0 . 32696 

0,65270 

21  . 93 

0.66190 

0.2  0.2 

0,0400 

1.000 

1 .03 

o , ? 7 ; t o 

0 , 5 8 1, 9 7 

0,135*3 

2 3.92 

0.62911 

0.2  0.2 

0,0730 

J.OOO 

1.83 

7.08737 

0.48/84 

0,429  78 

22.29 

0 ,69006 

0.2  0.2 

0.0090 

0.000 

2.22 

0 , 03  766 

0 . 38463 

0.60330 

20,98 

0.57454 

0.2  0.2 

0.1000 

7,000 

2,50 

3.32CO0 

0.27709 

0,707i; 

19.95 

0.49443 

0.2  0.2 

o.ioeo 

9.000 

2,70 

0,01304 

0.2133O 

0.7-751 

19,13 

0.43278 

0.3  0.1 

0.0300 

1.000 

1.00 

0.27437 

0.56/76 

0.15791 

24,47 

0,92726 

0.3  0-1 

0.0030 

3.000 

1 . 77 

0.09393 

0 .49620 

0,40778 

23.57 

0.82492 

0.3  0.1 

0.0440 

0.000 

2.13 

0,0*477 

0. 40459 

0.54613 

22.88 

0,75237 

0.3  0.1 

0,0710 

7.000 

2.37 

0,03098 

0. 33950 

0.62952 

22.36 

0.69937 

0.3  0.1 

0.0700 

9,000 

2.50 

0.32167 

0.29408 

0,68434 

21.96 

0.65736 

0.3  0.2 

0,0600 

i.ooo 

1.0C 

0.22243 

0.04457 

0,13975 

22.66 

0. 70252 

0.3  0.2 

0.1000 

3.009 

1,87 

3.06340 

0.49519 

0.45140 

21.24 

0,5762V 

0.3  0.2 

0,1190 

0,000 

1,99 

0,32370 

0,34340 

0,63290 

19.95 

0,48466 

0.3  0.2 

0.1319 

7.000 

2.16 

0.01331 

0.24464 

0 , 73704 

16,9* 

0.41269 

0.3  0.2 

0.1390 

9, 000 

2.32 

0.00647 

0 , 15u05 

0,80147 

18.13 

0.35706 

0.3  0.3 

0,0900 

1.009 

1.03 

0,14667 

0.7116/ 

0.11965 

20.80 

0,47/32 

0.3  0.3 

0,1410 

3.000 

1.57 

0.02743 

0.50/47 

0,46515 

19,32 

0.40188 

0.3  0.3 

0.1440 

0.000 

1.82 

0,01020 

0.32686 

0.66288 

16.01 

0,33498 

0.3  0.3 

0,1790 

7.000 

1,99 

5.00522 

0.22206 

0,77271 

16.92 

0.27579 

0.3  0.3 

0.1090 

9,000 

2.10 

0.00312 

0.15874 

0.8381* 

16.04 

0.22878 

0.4  0.1 

0.0400 

1.000 

1.00 

0,26096 

0.54963 

0,18938 

24,27 

0.89542 

0.4  0.1 

0.0440 

3.000 

1.60 

0.0 84. 14 

0.45916 

0,45149 

23.68 

0.83094 

0.4  0.1 

0.7740 

5.000 

1.80 

0 , 30003 

0.36534 

8,58465 

23.23 

0.78210 

0.4  0.1 

0,0790 

7,000 

1.97 

3.3J'69 

0.30459 

0.66171 

22.90 

0,74560 

0.4  0.1 

0.0830 

9.OO0 

2.07 

0.02504 

0.26366 

0.71130 

22.66 

0,71648 

0.4  0.2 

0.0800 

1.000 

1.00 

0.17914 

0.68262 

0,13823 

21.88 

0.59230 

0.4  0.2 

0.1230 

3.000 

1.54 

0.03*95 

0,49708 

0.46696 

20.82 

0.52675 

0.4  0.2 

0.1410 

0.000 

1.76 

0.01558 

0.33615 

0.64627 

19.86 

C.*e272 

0.4  0.2 

0.1520 

7.000 

1.90 

0,00891 

0.24455 

T, 74653 

19.08 

0.40670 

0.4  0.2 

0.1590 

9.000 

1.94 

0.00587 

0.18644 

0,80768 

16.46 

0.36177 

0.4  0.3 

0.1200 

1.000 

1.00 

0,1*100 

0.74/38 

0.11657 

19.21 

0.33794 

0.4  0.3 

0.1740 

3.000 

1.47 

0.01739 

0.51216 

0,47044 

0.87020 

18.30 

0.32016 

0.4  0.3 

0.2000 

5.000 

1,47 

0,30560 

0.32*14 

17.25 

0.27751 

0.4  0.3 

0.2150 

7.000 

1.79 

3.0026* 

0.21795 

0,77936 

16.31 

0.231*9 

0.4  0.3 

0.2250 

9.000 

1,87 

0.30154 

0.15484 

0,84361 

15,52 

0.19311 

0.4  0.4 

0.1400 

1.000 

1.00 

0.122*9 

0 . 7ftb22 

0,10929 

17,39 

0.21097 

0.4  0-4 

0.2230 

3.000 

1.34 

0.01213 

0.61724 

0,47062 

16.85 

0,22627 

0.4  0.4 

0 . 2000 

0.000 

1,04 

0.00337 

0.31870 

0,67692 

15.90 

0.19948 

0.4  0.4 

0.2470 

7.000 

1,47 

0.00142 

0.2100* 

0,78854 

14,97 

0.16310 

0.4  0.4 

0.2780 

9,000 

1.74 

0.00074 

0.14593 

0,85332 

14.18 

0.13185 

0.0  0.1 

0.0000 

loop 

1.93 

0.22781 

0.54484 

0.22755 

24.18 

0.86063 

0.0  0.1 

0,0730 

3.000 

1.44 

0.07720 

0.42940 

0.4933* 

24.00 

0.86410 

0.5  0.1 

0.0110 

0.000 

1.42 

0,04500 

0.33616 

0,61683 

23.79 

0,64156 

0.0  0.1 

0.0840 

7.000 

1.72 

0,03150 

0.28238 

0.68610 

23.64 

0.82333 

0.0  0.1 

0.0*80 

9.000 

1,74 

0,02416 

0.24570 

0,73013 

23,53 

0.80928 

0.0  0.2 

0,1000 

i.ooo 

1.03 

0.10318 

0,69378 

0,15303 

21.47 

0,54676 

0.0  0.2 

0.1420 

3.000 

1.42 

0.02744 

0.48793 

0,48462 

21,13 

0.54090 

0.0  0.2 

3.1080 

o.ooo 

1.56 

0.01187 

0.33325 

0,65487 

20.56 

0.50222 

0.0  0.2 

0.1*70 

7.000 

1,47 

0.00701 

0.24*77 

0,74821 

20.06 

0.*6l88 

1.0  0.2 

0.1720 

9.000 

1.72 

0.00481 

0. 19019 

0,80499 

19.65 

0.42778 

0.0  0.3 

0.1000 

1.000 

1,00 

0,12408 

0.75192 

0.12399 

19.63 

0.29293 

0.0  0.3 

0,2040 

3,009 

1,37 

0,01377 

0.50326 

0,48296 

18,34 

0.31*22 

0.0  0.3 

0.2280 

5.000 

1.52 

0.00427 

0.31874 

0,67698 

17,60 

0.28559 

0.0  0.3 

0.2*10 

7.000 

1.41 

0.00197 

0.21685 

0.78137 

t*.*7 

0.24736 

0.0  0.3 

0,2000 

9.000 

1.87 

0,00113 

0.15624 

0,84263 

16.25 

0.21384 

0.0  0.4 

0.2000 

1.900 

1.00 

0,11167 

0.77668 

0,11164 

16.77 

0.17520 

0.0  0.4 

0,2840 

3.000 

1,32 

0.0105* 

0.51318 

0.47627 

16,57 

0,20903 

1.0  0.4 

0,2910 

0.000 

1,45 

0.00290 

0.31635 

0,66074 

15.7* 

0.1887* 

0.0  0.4 

0.3070 

7.000 

1.53 

0.00121 

0.20632 

0.7904* 

14.95 

0.15625 

0.0  0.4 

0.31*0 

9.000 

1,59 

0.00062 

0.1*542 

0,85395 

14.23 

0,12762 

O.o  0.0 

0.2000 

1.000 

1,00 

0,10762 

0.78*36 

0,10761 

16.1* 

0.14111 

0.0  0.0 

0.3170 

3,000 

1,27 

0,00990 

0.51/87 

0,47223 

15.98 

0,17909 

0.0  0.0 

0.3*00 

5,000 

1,38 

0.00269 

0.31/72 

0.67951 

15.18 

0.16255 

0.0  0.0 

0 ,3430 

7.000 

l,*5 

0.00110 

0.20/82 

0,79107 

14.32 

0.13242 

0.0  0.0 

0.3700 

0,000 

1.50 

0.00054 

0.14399 

0.85544 

13.88 

0,10590 
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From  Table  4.3,  it  can  be  seen  that  the  values  of  the  power 
function  (i.e.,  P(H^)),  for  different  states  of  nature  where  t=l, 
approach  or  achieve  the  desired  error  probability,™,  for  most 
values  of  the  nuisance  parameters,  p.  and  p ..  Also,  the  p, 
error  probabilities  (i.e.,  the  probability  of  accepting  HQ  when 
t=9)  vary  with  the  nuisance  parameters,  but  approach  or  achieve 
the  desired  value  (8=0.25)  in  most  cases.  The  test  is  shown  to  be 
more  powerful  if  one  of  the  nuisance  parameters  has  values  close 
to  0.5  as  opposed  to  extreme  values  close  to  0 or  1.  The  ASN 
function  for  this  test  varies  between  8.95  and  21.80. 

The  results  for  the  three  decision  test  are  similar.  Here, 
however,  the  power  has  been  reduced  somewhat  and  the  ASN  function 
is  generally  larger.  This  is  due  to  additional  hypotheses  under 
consideration.  The  test  properties  are  still  generally  acceptable 
for  most  values  of  the  nuisance  parameters  and  modification  of 
the  test  region,  as  explained  in  Chapter  7,  will  enable  one  to 
adjust  the  test  properties  to  be  within  the  desired  limits. 

Table  4.5  shows  the  test  properties  for  the  three  decision 
numerical  example,  with  the  region  modified  (as  explained  above) 
to  favor  Hq  at  the  truncation  trial  n^,  reducing  the  a error 
probability;  this  has  caused  a corresponding  loss  of  power  for 
the  test.  This  modification  was  made  to  facilitate  comparisons 
with  the  power  of  the  fixed  size  test  as  given  by  Harkness  (1959) . 
Table  4.6  shows,  for  a range  of  parameter  values. 


P(Ha;P1_,l 


1,t)=P(H1;p] 


,p  1,t)+P(H2;p1  ,p  ^t),  (4.25) 


I 

Table  4.5 

Trill  Proportion  for  the 
Three  Dr  'HOdii  To.- t I sample, 
(Kiwonrvj  II  ) 


»*l.  **.1 

Pll 

t 

X 

P(llj) 

P (II  ,1 

u 

P(Hj) 

ASN 

p<cn  -1 
0 

0.1  0.1 

0.0100 

1.000 

1.00 

0,00012 

0,96331 

0.01*31 

24,67 

0 , *7693 

0.1  0.1 

0,0220 

3.000 

2,20 

0.00003 

0.9266* 

0.0H12 

24,40 

0 , *2311 

0.1  0.1 

0,0300 

3,005 

3.00 

0.00002 

0.87366 

P.12630 

23.94 

0.6714* 

0.1  0.1 

0,0350 

7,000 

3,30 

9.00001 

0.62673 

0.17323 

23,92 

0.6279* 

0.1  0.1 

0.03«0 

9.000 

3,90 

n.ooooo 

0. 76144 

0.21255 

23.17 

0.79073 

0.?  0.1 

0,0200 

l.ooo 

1.00 

5,00158 

0.96693 

0,02*4* 

24.47 

0,94909 

0.2  0.1 

C.03V0 

3,000 

1 , 9*. 

0.0002* 

0 . 66943 

0 , 13626 

21.7* 

0.64*73 

0.2  0.1 

0,0500 

5,000 

2.50 

0 , 00010 

0. 76391 

0,21396 

23,01 

0.7713* 

0.2  0.1 

0,0320 

7.000 

2,63 

0.00003 

0.71193 

0,26199 

22.42 

0,7111* 

0.2  0.1 

0,0420 

6.000 

3, in 

0.00003 

0.66672 

0,33324 

21. *3 

0.6*380 

0.2  0.2 

0,0400 

1.000 

t.oo 

0,01231 

0.93662 

0.0510* 

23. *2 

0.62911 

0.2  0.2 

0,0230 

3.000 

1,63 

P.C0151 

0. 77<5» 

0.22569 

22.2* 

0.A600* 

0.2  0.2 

0,0693 

3.000 

2,22 

0.00044 

0,63369 

0,36367 

20. *6 

0.974*4 

0.2  0.2 

0.1000 

7.000 

2,50 

0.90018 

0.53266 

0.4*714 

l».*9 

0,49443 

0.2  0.2 

0,1060 

9.000 

2.70 

0.00009 

0.4316* 

0.54205 

1 * . 1 3 

0.43278 

0.0  0.1 

0,0300 

1,000 

1.00 

0.00*23 

0 . 96001 

0,03374 

24,47 

0 , *2226 

0.3  0.1 

0,0330 

3.000 

1.77 

0.00090 

0.63361 

0,14322 

23. *7 

0,62492 

0.3  0.1 

0,0440 

5.000 

2.13 

0.00030 

0.77136 

0.22*34 

22,66 

0.75237 

0.3  0.1 

0.0210 

7,000 

2.37 

0.0001* 

0.7100* 

0.2*982 

22,36 

0,69637 

0.3  0.1 

0.0250 

9,000 

2.30 

0.3000* 

0 . 6 £ *5* 

0,31336 

21. *6 

0.65736 

0.70252 

0.3  0.2 

0.0600 

1.000 

1.00 

0. 03027 

0.910*0 

0.05933 

22.86 

0.3  0.2 

0.1000 

3,000 

1,47 

0.30376 

0.73265 

0,2*40* 

21.2* 

0.»7»29 

0.3  0.2 

0.1190 

3.000 

1.96 

0 . 00091 

0.56036 

0,41670 

1* . *5 

0 ,4646* 

0.3  0.2 

0.1310 

7,000 

2,16 

9.00036 

Q.47*0« 

0,52553 

18,** 

0.4126* 

0.3  0.2 

0,1390 

9.000 

2,32 

0.0001* 

0.398*2 

0,6013* 

18,13 

0.3*706 

0.3  0.3 

0.0*00 

1.000 

1.00 

0 . 034*9 

0.17*63 

6,07047 

0,32001 

20.80 

0.47732 

0.3  0.3 

0.1410 

3,000 

1.37 

0.90341 

0.67*57 

l*.  32 

0.40106 

0.3  0.3 

0,1*40 

0,1290 

3.000 

1,62 

0.00147 

0.49,66 

0.37977 

0,30064 

16.01 

0.33498 

0.3  0.3 

7.000 

1.9* 

9,00059 

0,61943 

16. *2 

0.27*79 

0.3  0.3 

0.1690 

9.000 

2.10 

0.00030 

0.29925 

0.700*4 

16,04 

0,22678 

0.4  0.1 

0.0400 

1.000 

1.00 

0.0141* 

0.95367 

0,02999 

24,27 

0.69*42 

0,630*4 

0.4  0.1 

0.0*40 

3.000 

1.60 

0.30167 

0.87*17 

0.1239* 

23, *8 

0.4  0.1 

0,0740 

0.0790 

5.000 

1.83 

0.00061 

0.80809 

0,19129 

23,23 

0.78210 

0.4  3.1 

7.090 

1.95 

0.0002’ 

0.76*31 

0.23740 

0.2703* 

22. *0 

0.74*00 

0.4  0.1 

0.0630 

9.000 

2.07 

0.0001* 

0.72543 

22,6* 

0.71048 

0.4  0.2 

0.0600 

1.000 

1.00 

0.04*39 

0.69327 

6,0*034 

21.88 

0.9*230 

0.4  0.2 

0.1230 

3.000 

1.3* 

0.00494 

0.72766 

0 , 26737 

20.62 

0.3267* 

0.4  0.2 

0.1410 

3,000 

1.76 

0.00144 

0.58246 

0.4160* 

1*.S» 

0.46272 

0.4  0.2 

0.1320 

7.000 

1.90 

0.000*2 

0.4636* 

0.51370 

i*.oe 

0.40470 

0.4  0.2 

0.1390 

9,000 

1.99 

0.00033 

0.41453 

0,3*314 

18.46 

0.36177 

0.4  0.3 

0.1200 

1.000 

1.00 

0. 0*6*1 

0.65693 

0,0744* 

l*.2l 

0,337*4 

0.4  0.3 

0.1760 

3.000 

1.47 

0.00*6* 

0.63*33 

0.338*2 

16.30 

0.3201* 

0.4  0.3 

0.2000 

3,000 

1.67 

0.00191 

0.47*63 

0.5234* 

17.2* 

0,277*1 

0.4  0.3 

0.2150 

7,000 

1.79 

0,00079 

0.35752 

0,6416* 

16.31 

0,2314* 

0.4  0.3 

0.2230 

9.000 

1,87 

0.000*1 

0.27928 

0.72030 

19.  *2 

0.1*311 

0.4  0.4 

0.1*00 

1.000 

i.oo 

0.37613 

0.6*202 

0.074*4 

17.3* 

0.210»7 

0.4  0.4 

0.2230 

3.000 

1,39 

0.00773 

0 . *2321 

0,36703 

16.69 

0.22*27 

0.4  0.4 

0.2300 

3,000 

1,36 

0.0021* 

0.43*56 

0,5632* 

19, *0 

0.1*»«8 

0.4  0.4 

0.2*70 

7,000 

1,67 

0.00091 

0.31363 

c.*a»4» 

14, *7 

0.1*310 

0.4  0.4 

0.2760 

9.000 

1.74 

0,0004* 

0.23302 

0.76452 

14.18 

0.1318) 

0.0  0.1 

0.0300 

1.090 

1.00 

0.02303 

0.»5*27 

0,02267 

24,18 

0,660*3 

0.3  0.1 

0*0730 

3.000 

1,46 

0.00303 

0.90603 

0,06*91 

24.00 

0.6*400 

0.5  0.1 

0.0610 

3,000 

1 , *2 

0.00102 

0,66680 

0,13217 

23.7* 

0.8415* 

0.3  0.1 

0.0*60 

7,000 

1.72 

0.00049 

0.63930 

0.16020 

23.84 

0.82333 

0.3  0.1 

0.06*0 

9,000 

1.76 

0.00026 

0.62012 

0.17936 

23.93 

0,60928 

0.5  0.2 

o.tono 

1.000 

1.00 

0.05662 

n. 86/22 

0.05615 

21.47 

0 ,54676 

0.3  0.2 

0.1420 

3.090 

1.42 

0.00632 

0.74913 

0. 2**53 

21.13 

0.94090 

0.3  0.2 

0.1360 

3.000 

1,58 

0.00196 

0.62*23 

0,373*0 

20,96 

0.90222 

0.3  0.2 

0.1670 

7.000 

1.47 

0.00089 

0.54050 

0.45161 

20.0* 

0.46166 

0.3  0.2 

0.1720 

9.000 

1,72 

0.0004’ 

0 • *8, 23 

0,51721 

1* . *9 

6,42776 

0.3  0.3 

0.1500 

1.000 

1.00 

0.07423 

0.65174 

0,07403 

16.63 

0.29293 

0.3  0.3 

0.20*0 

3,000 

1,37 

0.00774 

0.65662 

0,33363 

16.34 

0.31422 

0.3  0.3 

0.22*0 

5.010 

1.32 

0,00229 

0.46192 

0,50*79 

17.60 

0.2*999 

0.5  0.3 

0.2*10 

7,000 

1.61 

0.90100 

0.37,62 

0,62136 

16.67 

9,2473* 

0.3  0.3 

0.2300 

9,000 

1 , *7 

0 . 00053 

0.30392 

0,69*54 

16.29 

0.213*4 

0.3  0.4 

0,2000 

1.000 

1.00 

0,08097 

0,63621 

0,06067 

16,77 

0.17*20 

0.3  0.4 

0.2*40 

0.2*10 

3.000 

1.32 

0.00820 

0.620*1 

6.37096 

14.97 

0.20*03 

0.3  0.4 

3.000 

1.43 

0.00237 

0.43142 

0,56620 

19.76 

0.1*878 

0.3  0.4 

0,3070 

7.000 

1.53 

0.00101 

0.31,30 

0.66669 

14. *9 

0.19*29 

0.S  0.4 

0,3160 

9.000 

1,59 

0,00033 

0.23321 

0.7*42* 

14,23 

0.12762 

0.3  0.3 

0.2300 

1.000 

1.00 

0.06255 

0,63492 

0,062*3 

l*.l* 

0.14311 

0.3  0.5 

0.3170 

3,005 

1.27 

0.00*31 

0 .*1122 

0.36046 

19, *6 

0.17*0* 

0.3  0.3 

0,3*50 

5.000 

1,38 

C.002J* 

0.4172* 

0,5603) 

19,16 

0,1*299 

0.3  0.5 

0.3*30 

7.000 

1.43 

0.  10101 

0.29629 

0,7026* 

14,32 

0.13242 

0.3  0.3 

0.3750 

9.000 

1.30 

0 . 10052 

0.21662 

0.76066 

13,96 

0.109*0 
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Table  4.6 

Comparison  with  Fixed  Size  Tests 


Fixed  Size  Tests  Sequential  Test 


pl. 

P.l 

A* 

P20  ^Hl^ 

P30(I‘l> 

P (H.) 

!■»  X 

ASN 

.1 

.1 

1.00 

.050 

.050 

.015 

24.87 

.1 

.1 

3.90 

. 109 

. 213 

23.  17 

.2 

.1 

1.00 

.050 

.050 

.031 

24. 67 

.2 

.1 

3.10 

.153 

. 333 

21.93 

.2 

. 2 

1.00 

.050 

.050 

.06  3 

23.92 

.2 

.2 

2.70 

.283 

. 542 

19.13 

.3 

.1 

1.00 

.050 

.050 

.040 

24.4  7 

.3 

.1 

2.50 

. 157 

. 269 

. 336 

21 . 96 

.3 

.2 

1.00 

.050 

.050 

.090 

22.86 

.3 

2 

2.32 

. 340 

. 534 

.602 

18. 1 3 

.3 

. 3 

1.00 

.050 

.050 

.12  5 

20.80 

.3 

.3 

2.10 

.448 

. 658 

.701 

16.04 

.4 

.1 

1.00 

.050 

.050 

.044 

24. 27 

.4 

.1 

2.07 

.139 

. 242 

. 542 

19.13 

.4 

.2 

1.00 

.050 

.050 

.107 

21.88 

.4 

.2 

1.99 

.333 

532 

.590 

18.46 

.4 

.3 

1.00 

.050 

.050 

.143 

19.21 

.4 

. 3 

1.87 

.474 

. 684 

.721 

15.52 

.4 

.4 

1.00 

.050 

.050 

. 158 

17.  34 

.4 

.4 

1.74 

. 546 

.754 

.765 

14.18 

.5 

-1 

1.00 

.050 

.050 

.046 

24. 18 

.5 

i 

1.76 

.115 

. 195 

.180 

2 3.53 

.5 

. 2 

1.00 

.050 

.050 

.113 

21.47 

C, 

.2 

1.72 

.282 

.472 

. 518 

23.64 

.5 

. 3 

1.00 

.050 

.050 

.159 

18. 63 

.5 

.3 

1.67 

.453 

. 666 

.696 

16.  25 

.5 

.4 

1.00 

.050 

.050 

.162 

16.  77 

.5 

.4 

1.59 

.520 

. 750 

.765 

14.23 

.5 

. 5 

1.00 

.050 

.050 

.164 

16.  14 

.5 

. 5 

1.50 

.577 

.780 

.782 

13.58 

*»=  Pu/<(Pl.  HP.!*) 
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(which  is  the  power  function)  for  the  sequential  test  (Pg(*)) 
whose  properties  are  shown  fully  in  Table  4.5  and  for  the  fixed 
size  sample  tests  as  given  by  Harkness  (1959).  The 

fixed  size  test  properties  are  given  for  sample  sizes  of  20  and 
30.  The  missing  values  in  the  table  were  not  provided  by 
Harkness.  The  ASN  function  for  the  sequential  test  is  also 
shown  in  Table  4.6. 

It  can  be  seen  from  Table  4.6,  using  the  value  of  the  ASN 
function  to  decide  which  fixed  size  procedure  to  compare  with 
for  different  points  in  the  parameter  space,  that  the  sequential 
procedure  has  considerable  advantage.  Where  the  error 
probabilities  are  comparable,  the  ASN  function  is  considerably 
smaller  than  the  fixed  size  test  necessary  to  obtain  the  same 
power . 


l"‘  - - ^ 


I 

I 


CHAPTER  5 


A NEW  SEQUENTIAL  TEST  FOR  THE  EQUALITY 
OF  TWO  UNKNOWN  BINOMIAL  PROPORTIONS 

5.0  INTRODUCTION 

This  chapter  presents  a new  sequential  test  for  the  equality 
of  two  unknown  binomial  proportions.  Several  other  such  tests 
have  been  suggested  in  the  past;  a brief  review  of  the  relevant 
literature  is  contained  in  the  first  section,  followed  by  a de- 
scription of  the  underlying  probability  model.  Section  5.2 
develops  the  theory  for  the  sequential  test  and  the  following 
section  describes  the  evaluation  of  the  resulting  sequential  test 
regions.  Both  two  and  three  decision  test  procedures  are  con- 
sidered. The  last  section  gives  further  numerical  examples  and 
compares  the  tests  with  some  other  similar  tests,  both  fixed 
size  and  sequential. 

5.1  TESTS  WHICH  COMPARE  TWO  UNKNOWN  BINOMIAL  PROPORTIONS 

One  of  the  most  common  statistical  problems  arising  in 
practice  is  the  comparison  of  two  unknown  binomial  proportions. 

It  occurs,  for  example,  when  comparing  two  drug  treatments,  two 
production  processes,  or  two  teaching  methods.  The  underlying 
probability  model  of  this  situation  is  depicted  in  Figure  5.1, 
where  p^  is  the  probability  that  a member  of  population  1 
selected  at  random  will  have  attribute  D;  p ^ is  the  same  proba- 
bility for  population  2. 

I 
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Population  1 
Population  2 


D D 


Figure  5.1 


Probability  Model  for  the 
Two-Sample  Binomial  Problem 


A sample  arising  in  such  a situation  with  n-^  observations 
from  population  1 and  n2  observations  from  population  2 is 
represented  tabularly  in  Figure  5.2. 

D D 

Population  1 
Population  2 


X 

n^-x 

nl 

y 

n2-y 

n2 

Figure  5.2  Observed  Data  from  a Two-Sample 
Binomial  Experiment 


The  probability  of  observing  the  sample  in  Figure  5.2  is  the 
joint  distribution  of  two  independent  binomial  distributions. 
That  is, 


P(xfy;nx  ,n>1,p1,p2)  = 


n.  -x 

pl(1"pl) 


P2 (1-p2 


n2-y 

(5.1) 


The  hypothesis  usually  being  tested  in  this  situation  is 


and  the  test  can  be  either  a one-sided  (two  decision)  or  a 
two-sided  (three  decision)  procedure.  Tests  of  such  hypotheses 
are  treated  in  detail,  for  example,  by  Fleiss  (1973) 

It  can  be  shown  that  the  type  of  tests  considered  here  are 
asymptotically  most  powerful  if  equal  sample  sizes  are  taken  fro^ 
each  population  (Lehmann,  1959).  For  small  samples,  the  amount 
of  information  obtained  is  dependent  on  the  sample  outcome.  For 
this  reason,  and  for  simplicity,  although  the  results  presented 
here  are  perfectly  general,  it  will  be  assumed  that  n^  and 
shown  in  Figure  5.2,  are  equal;  sequential  tests  for  this  special 
case  are  developed  here. 

For  large  samples,  the  central  limit  theorem  allows  the  use 

of  the  normal  approximation  for  this  test;  this  is  equivalent  to 
2 

the  x test  with  one  degree  of  freedom  and  was  first  used  by  Karl 
Pearson  (1900).  For  small  samples,  Fisher's  exact  test,  as  de- 
scribed in  Section  4.2,  is  appropriate. 

Because  one  margin  is  controlled  by  the  experimenter,  Fisher's 
exact  test  is  conditioned  on  the  one  remaining  random  margin.  As 
shown  in  Section  4.2,  the  hypergeometric  is  again  the  null  dis- 
tribution. This  test  has  also  been  criticized  because  it  limits 

1 

the  reference  set  of  possible  outcomes;  however,  it  is  now  gen- 
erally accepted  as  correct.  The  power  of  this  test  has  been  oval- 

I 

uated,  for  example,  by  Bennett  and  Hsu  (1960)  and  Harkness  (1959). 
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It  should  be  noted  that  the  probability  model  in  (5.1) 
is  not  correct  if  there  is  "pairing"  within  observations.  This 
occurs  if,  at  each  trial,  observations  are  not  procured  at  random, 
but  rather  chosen  in  pairs  from  different  strata  (which  will 
affect  the  frequency  of  a given  response) . That  is,  each  pair 
is  matched  with  respect  to  some  characteristics  (e.g.,  by  age  when 
testing  the  value  of  two  new  drugs) . Such  "pairing"  is  often  used 
to  reduce  the  variability  between  the  individual  observations  and 
can  result  in  a more  powerful  test.  The  extreme  case  of  such  pair- 
ing occurs  in  drug  testing,  for  example,  when  a patient  receives 
both  treatments  being  tested  at  different  times.  Thus,  there  is 
some  correlation  between  the  treatments.  McNemar  (1949)  and 
Cochran  (1950)  treat  such  tests.  A comprehensive  review  of  this 
subject  is  given  by  Fleiss  (1973).  The  sequential  tests  presented 
here  assume  that  the  two  treatments  are  assigned  to  subjects  at 
random  or  that  one  observation  is  taken  at  random  from  each  pop- 
ulation at  each  trial  in  order  to  compare  the  two  unknown  binomial 
proportions;  that  is,  there  is  no  "pairing"  of  the  observations. 

The  odds  ratio 


P-i  ( 1— Pp ) 
t=  Pjd-Pi)  ' 


(5.3) 


on  which  these  tests  are  based,  is  analogous  to  the  cross  product 
ratio  discussed  in  Lection  4.1.  If  t=l,  p^  and  p ^ are  equal.  If 
t>l,  p^  is  greater  than  and  if  t<l,  p^  is  less  than  p£.  As 
explained  in  Section  4.1,  the  odds  ratio  is  the  most  appropriate 
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method  of  comparing  two  proportions  over  a wide  range  of  param- 
eter values.  Table  4.1  shows  the  odds  ratio  as  a function  of 
p^  and  p2«  This  table  can  be  used  to  aid  one  in  cnoosing  the 
proper  values  of  the  odds  ratio  to  use  in  a given  test  situation. 


5.2  CONSTRUCTION  OF  THE  SEQUENTIAL  TEST  REGIONS  FOR  TWO  AND 
THREE  DECISION  TEST  PROCEDURES 


In  this  section,  the  literature  concerning  sequential 
tests  for  comparing  two  binomial  proportions  is  briefly  re- 
viewed. Following  this,  it  is  shown  how  the  results  of  the 
last  chapter  can  be  modified  to  solve  such  problems  sequen- 
tially and  with  a sufficient  statistic. 

There  have  been  many  suggested  sequential  procedures 
for  comparing  two  binomial  proportions,  as  explained  above. 

Th<?  important  ones  are  mentioned  here;  a more  thorough  review 
is  given,  for  example,  by  fiksoy  (1972).  Wald  (1947)  suggests  a 
procedure  which  ignores  ties  when  they  occur  and  uses  the  test 
statistic  D=x-y,  where  x and  y are  the  number  of  observed  suc- 
cesses for  populations  1 and  2 respectively.  The  test  then 
reduces  to  a test  of  a single  binomial  proportion.  Wald  com- 
ments that  because  the  statistic  D is  not  sufficient,  this 
procedure  is  not  in  general  optimal.  It  can  be  shown,  however, 
by  using  the  two  sample  sequential  procedure  of  Girshick  (1946) , 


that  D is  sufficient  for  testing  the  special  case 


H 

versus  H 


0: 

r 


^V1 

t=vt0 


(5.4) 


* 


J 
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where  t is  the  hypothesized  odds  ratio  shown  in  (5.3). 

Ghosh  (1970)  reviews  the  theory  of  this  test.  He  also 
treats  in  detail  the  concept  of  Fraser  sufficiency  (Fraser,  1956) 
which  can  be  used  to  treat  certain  problems  with  nuisance  param- 
eters. For  the  important  cases  when  one  must  test  hypotheses 
different  than  (5.4)  (e.g.,  for  the  equality  of  and  p^, 

implying  t=l) , D=x-y  is  no  longer  sufficient.  Wald,  however, 
points  out  that  for  large  samples  there  is  little  loss  of  effi- 
ciency. The  test  presented  here  uses  a sufficient  statistic 
and  is  valid  for  small  samples. 

Tests  similar  to  the  above  have  been  used  by  several 
authors  to  test  the  null  hypothesis  P1=P2;  these  include  Bross 
(1952),  Armitage  (1960),  Choi  (1968),  6ksoy  (1972),  and  Elfring 
and  .Schultz  (1973a).  Except  for  being  truncated,  most  of  these 
plans  have  regions  similar  to  those  proposed  by  Wald  (1947) . 

In  practice,  such  tests  are  almost  always  truncated  at  some 
trial  n^  in  order  to  eliminate  the  possibility  of  large  sample 
sizes.  This  is  especially  true  for  certain  applications  such  as 
medical  trials.  In  the  papers  of  (5kr.oy  (1972)  and  Elfring  and 
Schultz  (1973a) , the  sequential  test  properties  are  found  exactly 
by  using  the  direct  method  of  sequential  analysis.  Also,  their 
tests  are  truncated  at  a fixed  trial,  rather  than  at  a fixed 
number  of  untied  pairs,  as  is  the  case  with  the  tests  of  Armitage 
and  Wald,  for  example.  These  tests  can  be  made  quite  efficient 
if  one  knows  in  advance  the  approximate  values  of  p^  and  p£. 

This  is  done  by  a trial  and  error  procedure,  comparing  the 
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test  properties  for  alternate  teats  plans,  as  explained  by 
Oksoy  (1972) . Hall  (1965)  suggests  a sequential  test  which  is 
conditional  on  the  observed  ancillary  statistic  at  each  trial. 

If  the  sequential  test  is  based  on  a sufficient  statistic, 
a powerful  test  can  be  found  over  a much  wider  ranger  of  param- 
eter values.  The  sequential  tests  presented  here,  a special 
case  of  the  tests  given  in  Chapter  4,  are  based  on  such  a 
statistic. 

It  will  be  convenient  to  use  the  notation  of  Figure  3.2 

with  the  following  modification.  It  is  assumed  that  the  right- 

hand  margin  is  controlled  such  that  equal  sample  sizes  are 

taken  from  each  population.  Thus  n.  =n/2  for  all  n.  The 

1 • 

quantity  n ^ is  still  a random  variable  and  equal  to  the  total 
number  of  successes  found  in  both  populations  (and  n ^-x  is  the 
number  of  successes  found  in  population  2) . The  joint  dis- 
tribution of  the  sample  (x,n  ,-x)  at  trial  n is 


i 


I 


To  examine  the  nature  of  the  hypothesis  being  tested, 
one  can  reparameterize  this  into  the  logistic  model.  This  formu- 
lation was  first  suggested  by  Cox  (1958)  and  is  further  treated 
Cox  (1970)  and  Gart  (1971).  In  the  reparameterized  model, 


_ exp  (Bt A/2) 
pl"  1+exp  (B+A/2 ) 


_ exp (B-A/2) 
p2~  1+exp (B-A/2) 


(5.6) 
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From  this  it  is  easy  to  see  that  the  odds  ratio  is 


P'd-Pi 

p2a-p2) 


=exp 


(A)  . 


(5.7) 


Thus  A=  £n  (p^/l-p^ ) -£n  (p2/l-p2 ) ) is  the  difference  in  logits  and 
is  also  known  as  the  log  odds  ratio.  The  probabilities  and 
P2  are  equal  when  t=l/  implying  A=0.  Using  this  form,  the  joint 
probability  function  of  x and  n ^-x,  when  n^  pairs  have  been 
sampled  is 


P (x, n i~x;n^  ,A,6)= 


exp ( ( A/2)  (2x-n  )+8n 

• X 


( 1+exp ( 3+ A/2 ) ) (l+exp(6-A/2) ) 


(5.8) 


The  degree  of  inequality  of  p^  and  p2  is  expressed  in  terms 
of  the  parameter  A.  The  parameter  B is  related  to  the  actual 
parameter  values  p^  and  p2<  In  (5.8),  n ^ is  the  sum  of  the 
successes  from  both  populations.  The  quantity  2x-n  ^ is  the  dif- 
ference between  the  number  of  successes  observed  from  populations 
1 and  2.  It  can  be  seen  in  (5.8)  that  although  the  probability 
function  cannot  be  completely  factored,  factorization  of  the 
numerator  (the  denominator  is  not  subject  to  random  variation) 
shows  that  2x-n  . and  n . are  sufficient  for  A and  B respectively. 

• X • X 

It  is  desired  to  make  inferences  on  A,  the  log  odds  ratio. 

The  quantity  n . is  therefore  an  ancillary  statistic  for  3-  When 

• X 

making  inferences  about  A,  it  is  proper  to  consider  the  conditional 


distribution  of  2x-n  . (or  x itself — the  distributions  are 

■ X 

equivalent)  given  the  observed  value  n 1 . This  conditional 

• X 


distribution  is  the  extended  hypergeometric  distribution  shown 
(4.7),  except  that  t is  now  equal  to  the  odds  ratio  rather  than 
the  cross  product  ratio.  The  null  distribution  is  again  the 
hypergeometric  shown  in  (4.8),  which  does  not  depend  on  the 

! 

nuisance  parameter  6. 

i 

To  conduct  the  sequential  tests  for  this  case,  an  observa- 
tion is  chosen  at  random  from  each  of  the  two  populations  at 

1 

each  trial.  The  sequential  test  rules  are  similar  to  those  shown 

in  (3.16),  with  the  modification  that  n =n/2  is  really  the 

• 

trial  number  and  each  trial  consists  of  one  observation  from  each 

2 

population. 

For  this  case,  the  sequential  test  rules  are: 


accept  Hq 

if 

X-CLlnl.'n.l 

accept 

if 

XJCu,ni.'\l 

(5.9) 


and  otherwise  continue  the  test  and  take  another  sample.  These 
critical  values  are  based  on  the  theory  developed  in  Section  4.! 
and  are  thus  found  as 


CL(n 


l.'n.l>=  [^_1(b,ni. 'H. 1 , 2ni . ,t0'tl)] 


= ^(b+F(t0)-F(t1))/£n(t1)-4n(t0))]  (5.10) 


:u(ni.'n.i)_  [g  (a,ni. ,n.i,2ni. +1 

= [(a+F(tQ)-F(t1)  )/(Jln(t1)-in(t0)  )]  +1 


i'i  JTimiiiii  ■■ 


i jj 


103 


using  the  same  notation  as  in  (4.17).  Here  there  are  only  2n.  +1 

i.  • 

possible  values  for  n ^ at  each  trial  . That  is,  Oin  . 

Tables  of  the  test  procedure  critical  values  will  therefore  be 
much  smaller  than  those  of  the  cases  considered  earlier.  A 
numerical  example  for  this  case  follows. 

The  hypothesis  of  equal  probability  of  success  lor  the  two 
populations  is  specified  as 


V t=t0=1 


versus  : t=t1=5 


(5.11) 


The  desired  a and  6 error  probabilities  are  chosen  to  be  0.025 
and  0.2  respectively.  The  computer  program  in  the  Appendix  was 
used  to  generate  the  table  of  critical  values,  defining  the  test 
rules,  shown  in  Table  5.1.  These  tests  are  truncated  as  in  the 
previous  tests  presented  here.  The  method  of  finding  the  exact 
properties  of  this  sequential  test  procedure  is  given  in  the  next 
section  and  the  sequential  test  region  shown  in  Table  5.1  is 
evaluated  there  as  a numerical  example. 

In  order  to  conduct  such  a test,  at  each  trial  one  selects 
an  item  at  random  from  each  of  the  two  populations.  A score  is 
kept  of  the  cumulative  number  of  successes  in  both  populations. 
One  then  compares  at  each  trial  the  total  number  of  successes  in 
population  1 with  the  critical  value  for  the  corresponding  margin 
totals,  using  the  test  rules  in  (5.9).  A numerical  example  of 


this  procedure  follows. 
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Table  5.2  contains  a typical  sequential  sample  which  might 
be  obtained  using  the  above  test  procedure.  Here  a 1 represents 
a success  and  aO  represents  a failure. 


Table  5.2 

Typical  Sequential  Sample 


i 

: 


TRIAL 

1 

2 

3 

4 

5 

6 

7 

8 


POPULATION  1 

1 

1 

0 

0 

1 

0 

1 

0 


POPULATION  2 

1 

0 

1 

0 

0 

1 

1 

1 


2 

3 

4 

4 

5 

6 
8 
9 


x 

1 

2 

2 

2 

3 

3 

4 
4 


The  results  of  this  sample  at  trial  8 (i.e.,  after  8 
pairs  have  been  observed)  are  summarized  in  Figure  5.3. 


4 

4 

8 

5 

3 

8 

9 

7 

16 

Figure  5.3  Summary  of  Data  From 

Sample  Sequential  Test 


From  examination  of  the  critical  values  in  Table  5.1,  it  is  seen 
that  x=4  is  a lower  critical  value  when  n ^=9;  therefore,  the 
test  is  terminated  there  and  a decision  is  made  in  favor  of  HQ. 
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The  three  decision  test  procedure  to  test  the  hypotheses 


H0:  ^1^0 


versus  : t=tQ 


(5.12) 


versus  H2 : t=t^>tg 

is  similar  to  that  given  in  Section  3.4. 

Again,  two  SPRTs  are  used  simultaneously;  therefore  two 
sets  of  tables  like  thot  } in  Table  5.1  are  computed.  The  rules 
for  carrying  out  the  sequential  test  are: 


accept  if 


accept  Hq  if 


accept  H2  if 


xsc.  (n  ,n  . ) 

J-i  1 • • 1 

X<-dL(nl.'\l) 

Xicu(nl.'n.i’ 

XSdL(nl.-n.l) 

X4co(ni.'n.l) 

XidU(nl.'n.l> 


(5.13) 


where  cT(*)  and  cM(-)  are  the  lower  and  upper  limits  for  SPRT1 
(i.e.,  for  the  first  pair  of  hypotheses  in  (5.12))  and  dL  ( • ) and 
dy(*)  are  the  upper  and  lower  limits  for  SPRT2  (i.e.,  for  the 
second  pair  of  hypotheses  in  (5.12)).  These  limits  are  found 
in  a manner  analogous  to  that  in  Section  3.4,  using  (5.10). 

As  a numerical  example,  consider  testing  the  hypotheses 

Hl:  t=tr0-2 


versus  HQ:  t=tQ=l. 0 


(5.14) 


versus  t=t2=5.0 


■ 


f 


If  II 1 1 1 1 -I  II. ...... 


I 

[ 

[ 


107 


The  desired  error  probabilities  are  chosen  to  be  a^=a^=0.025 
and  8^=82*0*2.  It  is  again  necessary  to  generate  two  sets  of 
critical  values,  one  each  for  testing  between  and  HQ  and 
between  HQ  and  The  first  s »t  of  critical  values  is  shov/n 

in  Table  5.3;  the  second  set  is  the  same  as  was  used  in  the 
previous  two  decision  numerical  example  and  is  shown  in  Table 
5.1.  The  test  region  is  again  truncated  as  before.  The  pro- 
cedure for  carrying  out  such  a test  is  as  explained  above,  using 
the  rules  in  (5.13). 
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1 

1 I 
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5.3  EVALUATION  OF  THE  SEQUENTIAL  TEST  REGIONS 

This  section  describes  the  method  used  to  find  the  exact 
test  properties  of  the  sequential  test  regions  developed  in  the 
last  section.  The  direct  method  of  sequential  analysis  is  used 
in  a manner  similar  to  that  of  Section  3.5.  Because  the  under- 
lying probability  model  and  the  test  procedure  are  different, 
there  are  some  changes.  These  are  outlined  below. 

At  each  tricl,  one  observation  is  taken  from  each  population 
on  the  right-hand  margin.  Let  x and  n ^-x  denote  the  number  of 
successes  observed  in  populations  1 and  2 respectively  at  trial 
n . From  each  point  (x,n  .-x,n.  ) in  the  sample  space  at  each 

X • • X X • 

trial  n , there  are  four  possible  outcomes  at  trial  n.  tl. 

X • X • 

They  are  (x+l,n  .-x+ljn.  +1),  (x+l,n  .-x,n.  +1),  (x,n  ,-x.n  +1), 

•X  X«  • X X • • X X* 

and  (x,n  .-x+l,n.  +1).  The  probabilities  of  each  of  these  occur- 

• x X • 

rences  are  shown  in  Figure  5.4. 
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<x-n1.-*<\1+l>  {(1-Pl)  (l-p2)| 


Figure  5.4  Possible  Outcomes  at  Each  Trial 

The  sequential  test  begins  at  trial  0 where  the  only  possi- 
bility is  (x*0,n  .-x^Ofn.  =0),  which  therefore  has  a probability 
of  1.  The  probabilities  of  reaching  each  point  (x,n  ^-x^  ) at 
trial  n^^  is  then  computed  recursively  for  n^  =l,2,...,n0  start- 
ing with  the  point  at  the  origin.  The  probability  of  reaching 
each  point  inside  or  on  the  boundary  of  the  sequential  test  region 
is  a function  of  the  true  state  of  nature,  which  is  completely 
specified  by  p^  and  p^.  The  OC  and  ASN  functions  and  the  dis- 
tribution of  the  DSN  will  therefore  be  functions  of  the^e  two 
parameters . 

Starting  at  trial  0,  the  probabilities  of  reaching  each  point 

( x ,n  .-X/n,  ) for  a specified  state  of  nature  are  computed  using 

the  multiplication  rule  and  summing  the  probabilities  of  all  the 

different  ways  one  might  reach  a point  in  the  space.  For  example, 

the  point  (x,n  .-x,^  ) at  trial  n,  could  have  been  reached  from 

one  of  four  points  at  trial  n.  -1,  that  is,  from  (x-l,n  .-x-l,^  -1)  , 

(x,n  ^-x-l,n^  -1),  (x-l,n  j-x,n^  -1)  or  from  (x,n^  -x,n^  -1).  Let 

Ai  denote  the  event  of 
n 


iHUWMWiillHHM 


\ 


no 


of  accepting  hypothesis  Jb=0,l  and  the  event  of  being  in  the 
continuation  region  at  trial  n,  that  is, 


A0n=  { (x,n  j-x^  )(x>cL(n1  ,n  :)} 

A1  = { (x,n  .-x,n.  ) | x<c  (n.  ,n  .)} 
n .1  l.'ui.  .1 


(5.15) 


Cn=  { (x,n  ^x^  ) | cL  (n  1 ,n  1)<x<cu(n1  ,n 

The  recursive  formula  used  to  find  the  probabilities  for  each 
point  in  the  (x,n  ) space  is 


Pg(x,n  j-x,^  ;P1#Pi)“ 


(5.16) 


I (x-1 , n ^x-l^  -1)  Pg  (x-l,n  ^-x-1 ; -1 , p1  ,p2 ) (p-j^ ) (p2 ) 

+I(x,n>1-x~l,n1  -1 ) Pg  (x, n j-x-ljn^  -lfpirp2)  (l-p1)p2 
+I(x-l,n  ^-x. n^  -l)Pg  (x-l,n  1~x;n;L  -l,p  ,p2)p1  (l-p2) 

+ I(x,n  1_x»n1  -l)Pg(x,n  ^x,^  -lfpirp2)  (l-p1)  (1-p  ) 


where 


and 


Pg(x,n1>-x;0,p1,p2)^ 


I(x,n1  -x,^  ) = 


1 if  x=n.  =n  =0 

X • • X 


0 otherwise 


1 if  (x,n  .-x,n.  ) eC 
. i 1 . n 


0 otherwise 


The  indicator  function  I accounts  for  the  termination  of  the  test 
when  one  of  the  critical  values  has  been  reached.  Once  again, 
one  need  only  compute  the  probabilities  for  those  points  inside 
or  on  the  boundary  of  the  sequential  test  region;  all  other 
points  have  probability  zero.  The  probabilities  of  each  of  the 


I 

I 

7 * 

, 
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events  Ai  , i**0,l  and  n,  -l,2,...nrt  must  be  computed  for  each 
nl.  1‘  0 

desired  state  of  nature  (p^,P2).  (The  computational  simplifi- 
cation given  in  Section  3.5  c in  again  be  used  here,  - Lth  some 
small  modification.)  The  probabilities  are  computed  as  follows 


P(Ain1/Pl'P2>° 


(5.17) 


2nl.  IU 

n f-0  x^IL  Ji(x'n.rX'nl.)PS(x'n.l"X;n.l'Pl'P2) 

where  IL=MAX(0,n  ^-n^  ) 

IU=MIN(n  .,n . ) 

• X X • 


Ji(x,n  ^x,^  ) = 


1 if  (x,n  .-x,n.  ) cAi 

• x j • n j 

0 otherwise 


The  indicator  function  J. , i=0,l  is  used  to  accumulate  all  of  the 

x 

probability  of  accepting  ir.  Once  these  probabilities  have  been 
computed,  one  can  find  the  exact  test  properties  by  using  the 
same  procedure  given  in  Section  3.5. 

The  procedure  for  finding  the  properties  of  a three  decision 
test  region  is  analogous  to  the  development  in  Section  3.6,  con- 
structing two  SPRTs  (i.e.,  sets  of  critical  values  for  the  test 
statistic)  to  be  run  simultaneously.  The  sequential  test  rules 
are  the  same  as  those  in  (3.25). 

As  a numerical  example,  the  sequential  test  regions  found  in 
the  last  section  and  evaluated  here.  The  hypothesis  being  tested 
for  the  two  decision  example  is 


112 


H 

versus  H 


0* 

1: 


t=t 


(5.18) 


with  a=0.025  and  8=0.2.  The  sequential  test  region  is  shown  in 
Table  5.1;  the  exact  test  properties  for  this  truncated  test 
region  are  shown  in  Table  5.4. 

For  the  three  decision  test  example,  the  hypotheses  being 
tested  are 

Hq : t=t1=0.2 

versus  H^:  t=tQ=l  (5.19) 

versus  t=t2=5, 

with  0^=02=0.025  and  81=82=®*^‘  T^e  sequential  test  regions  for 
this  example  are  shown  in  Tables  5.1  and  5.3.  The  exact  test 
properties  are  shown  in  Table  5.5. 

There  are  several  things  which  should  be  noted  about  the 
properties  of  these  tests.  First,  the  a error  probabilities 
(i.e.,  P(H^)  and  P(H2)  when  t=l,  give  a'^  and  a'2  respectively  for 
the  three  decision  test  procedure)  are  somewhat  higher  than  what 
was  specified  as  the  desired  probability.  Also,  the  sizes  cf  the 
error  probabilities  vary  with  values  of  p^=p2-  For  example,  when 
p^=P2=0.4  in  Table  5.5,  a'^o^o . 0459  and  when  p^=p2=0.5, 
a'^a^O.  0396 . The  power  of  the  test  (i.e.,  P(Hq)  when  t=5)  also 
varies  over  the  equal  values  of  t.  The  table  shows  clearly  that 
more  power  can  be  expected  if  one  of  the  probabilities  is  close  to 
0.5  (again  considering  equal  values  of  t over  the  (p  , p^ ) space). 


Tabic  5.4 

Two  Decision  p.^p. 
Example  Test  Properties 


Pi 

p2 

t 

P(Hq) 

POlj) 

ASN 

P ( C , 

V1 

0.10000 

0.10000 

1,0 

0.89162 

0,10636 

18.42 

0,45817 

0,10000 

0.05263 

2,0 

0.71863 

0.26137 

22.40 

0,76264 

0.10000 

0.03571 

3,0 

0.61290 

C. 38710 

23.63 

0,86946 

0.10000 

0.02703 

«,0 

0.54612 

0.45388 

24.15 

0,91677 

0.10000 

0.02174 

5,0 

0,50076 

0.49924 

24.42 

0,94153 

0.10000 

0.01618 

6,0 

0,46809 

0.53191 

24.58 

0,95602 

0,10000 

0.01562 

7,0 

0,44349 

0.55651 

24.67 

0.96519 

0.20000 

0.20000 

1,0 

0,92924 

0.07076 

14.48 

0,25443 

0.20000 

0.11111 

2,0 

0,70115 

0 . 29b85 

20.01 

0,59500 

0.20000 

0.07692 

3.0 

0,52774 

0.47226 

22.03 

0.7J372 

0.20000 

0 i 05082 

4,0 

0.41481 

0.58519 

22.92 

0,79312 

0.20000 

0.04762 

5,0 

0,33933 

0.66067 

23.38 

0.62104 

0.20000 

0.04000 

6,0 

0,28652 

0.71346 

23.64 

0.83494 

0.20000 

0,03446 

7.0 

0,24799 

0.75R01 

23.60 

0.84199 

0.30000 

0.30000 

1.0 

0.94623 

0.05377 

12.30 

0,16144 

0.30000 

0.17647 

2,0 

0.70231 

0.29769 

18.33 

0.46263 

0.30000 

0.12500 

3,0 

0,49521 

0.50479 

20.58 

0.60768 

0.30000 

0,09677 

«,0 

0.36012 

0.63968 

21.47 

0,64254 

0.30000 

0.07895 

5,0 

0.27242 

0,72756 

21.83 

0,64484 

0.30000 

0.06667 

6,0 

0.21342 

0.78658 

21.98 

0.63572 

0.30000 

0.05769 

7,0 

0.17214 

0.82786 

22.04 

0,62291 

0.40000 

0.40000 

1,0 

0.95642 

0.04358 

11.05 

0,11744 

0.40000 

0.25000 

2,0 

0.70523 

0.29477 

16.93 

0.39305 

0.40000 

0.18162 

3.0 

0.47149 

0.52651 

19.16 

0,49473 

0.40000 

0.14266 

4,0 

0.32054 

0.67946 

19.86 

0.50134 

0.40000 

0.11765 

5,0 

0,22686 

0.77314 

19.99 

0,47714 

0.40000 

0.10000 

6,0 

0.16710 

0.83290 

19.92 

0,44595 

0.40000 

0.08696 

7,0 

0.12741 

0.87259 

19.77 

0,41557 

0.50000 

0.50000 

1,0 

0.96234 

0.03766 

10.65 

0,10643 

0.50000 

0,33333 

2,0 

0.71993 

0.28007 

15.99 

0,34105 

0.50000 

0.25000 

3,0 

0.46620 

0.53380 

18.01 

0.41490 

0.50000 

0.20000 

4,0 

0,30129 

0.69671 

18.47 

0,39892 

0.50000 

0.16667 

5,0 

0,20165 

0.79615 

5 3.35 

0,35727 

0.50000 

0.14266 

6,0 

0,14085 

0.85915 

18.04 

0,31357 

0.50000 

0.12500 

7,0 

0.10204 

0.89796 

17.69 

0.27468 

0.60000 

0.60000 

1,0 

0.95642 

0.04358 

11.05 

0,11744 

0.60000 

0.42857 

2,0 

0.73222 

0.26778 

15.71 

0,32836 

0.60000 

0.33333 

3,0 

0,46183 

0.51812 

17.38 

0,37800 

0.60000 

0.27273 

4,0 

0,30535 

0.69465 

17.55 

0,34308 

0.60000 

0.23077 

5.0 

0.19715 

0,80285 

17.18 

0.28751 

0,60000 

0,20000 

6,0 

0.13211 

0.86789 

16.66 

0,23569 

0.60000 

0.17647 

7,0 

0.09211 

0.90769 

16.14 

0,19307 

0.70000 

0.70000 

1,0 

0.94623 

0,05377 

12.30 

0,16144 

0.70000 

0,53846 

2,0 

0.71230 

0.28770 

16.28 

0.35607 

0.70000 

0.43750 

3,0 

0.47531 

0.52469 

17.54 

0,38707 

0.70000 

0.36842 

4,0 

0,30923 

0.69077 

17.40 

0,33577 

0.70000 

0.31818 

5,0 

0.20265 

0.79735 

16.76 

0,26854 

0.70000 

0,28000 

6,0 

0.13580 

0.86420 

16,02 

0,20881 

0.70000 

0.25000 

7,0 

0,09372 

0.90628 

15.32 

0,16144 

o.eoooo 

0,80000 

1,0 

0,92924 

0,07076 

14.48 

0.25443 

0.80000 

0.66667 

2,0 

0,70235 

0.29765 

17,82 

0,44940 

0.00000 

0,57143 

3,0 

0,46793 

0.53207 

18.79 

0,46799 

o.eoooo 

0.50000 

4,0 

0,30129 

0,69671 

18.47 

0,39892 

0.80000 

0.44444 

5,0 

0.19647 

0.80353 

17,63 

0,31202 

o.eoooo 

0.40000 

6,0 

0,13211 

0,86789 

16,66 

0,23569 

o.eoooo 

0.36364 

7,0 

0,09192 

0.90606 

15.74 

0,17622 

0.90000 

0,90000 

1,0 

0,89162 

0.10638 

18.42 

0,45817 

0.90000 

0,81818 

2,0 

0.70037 

0.29963 

20,37 

0,61855 

0.90000 

0.75000 

3,0 

0,51075 

0,48925 

21.31 

0.67053 

0.90000 

0.69231 

4,0 

0,35654 

0.64346 

21.34 

0,63078 

0.90000 

0.64266 

5,0 

0,24415 

0.75585 

20.78 

0,54425 

0.90000 

0.60000 

6.0 

0.16710 

0.83290 

19.92 

0,44595 

0.90000 

0.56250 

7,0 

0,11569 

0.88431 

18.94 

0,35451 
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Table  5.5 

Three  Decision  p.»p. 
Example  Test  Properties 


pl 

p2 

t 

PfHj) 

P<»0> 

p(h2) 

ASN 

P(Cn  J 
nO“l 

0.10000 

0.10000 

1 . o 

0.10893 

0.78214 

0.10093 

24.63 

0.89490 

0.10000 

0.05263 

2,0 

0.03562 

0.68234 

0.28184 

24.68 

0.96410 

0.10000 

0.03571 

3,0 

0.01840 

0.59416 

0,38743 

24.94 

0.98260 

0.10000 

0,02703 

4,0 

0,01133 

0.53456 

0,45410 

24,96 

0.98879 

0.10000 

0,02174 

5,0 

0.00772 

0.49267 

0.49941 

24.97 

0.99128 

0.10000 

0.01816 

6,0 

0.00561 

0.46236 

0.53204 

24.97 

0.99241 

0.10000 

0.01562 

7,0 

0,00426 

0.43913 

0,55661 

24,97 

0.99296 

0.20000 

0.20000 

1,0 

0,07373 

0.85254 

0.07373 

22.52 

0.59699 

0.20000 

0.11111 

2,0 

0.01452 

0.67997 

0.30551 

23,94 

0.78741 

0.20000 

0.07692 

3,0 

0.00587 

0.51533 

0.47681 

24,32 

4, 65868 

0.20000 

0.05682 

4.0 

0.00319 

0.40606 

0.59075 

24.42 

0.88042 

0.20000 

0.04762 

5,0 

0.00203 

0.33273 

0.66525 

24,43 

0.88525 

0.20000 

0.04000 

6,0 

0.00142 

0.28134 

0.71725 

24,42 

0.88406 

0.20000 

0.03446 

7,0 

0.00105 

0.24360 

0.75515 

24.40 

0.88074 

0.30000 

0.30000 

1,0 

0,05686 

0.88629 

0.05686 

19.53 

0.36366 

0.30000 

0.17647 

2,0 

0.00616 

0.68306 

0.31078 

22.04 

0.59731 

0.30000 

0.12500 

3,0 

0,00165 

0.47715 

0.52120 

22.91 

0.69534 

0.30000 

0.09677 

4,0 

0.00069 

0.34365 

0.65566 

23.05 

0.71037 

0.30000 

0.07895 

5,0 

0.00037 

0.25804 

0.74139 

22.98 

0.69806 

0.30000 

0.06667 

6.0 

0,00023 

0.20106 

0.79871 

22.85 

0.67817 

0.30000 

0.05769 

7,0 

0.00015 

0.16154 

0,83830 

22.71 

0.65737 

0.40000 

0.40000 

1,0 

0.04592 

0.90817 

0.04592 

17.65 

0.25677 

0.40000 

0.25000 

2,0 

0.00336 

0 , 68783 

0.30882 

20.05 

0.45427 

0.40000 

0.18182 

3,0 

0,00060 

0.45009 

0.54931 

21.14 

0.54776 

0.40000 

0.14286 

4,0 

0,00018 

0,29854 

0.70129 

21.25 

0.54709 

0.40000 

0.11765 

5,0 

0.00007 

0.20643 

0.79350 

21.02 

0.51551 

0.40000 

0.10000 

6,0 

0,00004 

0.14691 

0.85106 

20.71 

0.47786 

0.40000 

0.08696 

7,0 

0,00002 

0.11147 

0.88851 

20.40 

0.44217 

0.50000 

0.50000 

1,0 

0.03958 

0.92065 

0.03958 

17.07 

0.23180 

0.50000 

0.33333 

2,0 

0.00219 

0.70465 

0.29316 

18.83 

0.38289 

0.50000 

0.25000 

3,0 

0,00030 

0.44469 

0.55501 

19.76 

0.45092 

0.50000 

0.20000 

4,0 

0.00007 

0.27606 

0.72187 

19.69 

0.43042 

0.50000 

0.16667 

5,0 

0.00002 

0,17976 

0.62020 

19.25 

0.38388 

0.50000 

0,14286 

6,0 

0.00001 

0,12096 

C.B7903 

18.73 

0.33575 

0.50000 

0.12500 

7,0 

0.00000 

0.08450 

0.91550 

18.24 

0.29316 

0.60000 

0.60000 

1,0 

0,04592 

0.90817 

0.04592 

17.65 

0.25677 

0.60000 

0.42857 

2,0 

0,00182 

0.71801 

0.28017 

18.60 

0.36713 

0.60000 

0.33333 

3,0 

0,00021 

0,46102 

0.53877 

19,07 

0.41043 

0.60000 

0.27273 

4,0 

0,00004 

0,28169 

0.71807 

18.71 

0.36944 

0.60000 

0.23077 

5,0 

0.00001 

0.17443 

0.82556 

18.03 

0.30861 

0.60000 

0.20000 

6,0 

0,00000 

0.11153 

0.88846 

17.31 

0.25239 

0.60000 

0.17647 

7,0 

0,00000 

0,07399 

0.92601 

16,65 

0.20634 

0.70000 

0.70000 

1,0 

0,05686 

0.88629 

0.05686 

19.33 

0.36366 

0.70000 

0.53846 

2,0 

0.00254 

0,69621 

0,30125 

19.19 

0.40247 

0.70000 

0,43750 

3,0 

0.00023 

0,45418 

0.54559 

19,24 

0.41947 

0.70000 

0,36842 

4,0 

0.00004 

0.28582 

0.71414 

18,56 

0.36170 

0.70000 

0,31818 

5,0 

0,00001 

0.17975 

0.82024 

17.62 

0.28864 

0.70000 

0.26000 

6,0 

0.00000 

0.11478 

0.88521 

16,67 

0.22411 

0.70000 

0.23000 

7,0 

0.00000 

0.07501 

0.92498 

15,82 

0.17305 

0.60000 

0.80000 

1,0 

0.07373 

0.85254 

0,07373 

22,52 

0.59699 

0.60000 

0,66667 

2,0 

0.00492 

0.68393 

0.31155 

21,32 

0.54182 

0.80000 

0.57143 

3.0 

0.00047 

0.44637 

0.55315 

20.69 

0.51438 

0.80000 

0,50000 

4,0 

0,00007 

0.27806 

0.72187 

19.69 

Q.43042 

0.60000 

0.44444 

5,0 

0,00002 

0.17400 

0.82396 

18,49 

0.33401 

0.60000 

0.40000 

6.0 

0,00000 

0.11153 

0.88646 

17.31 

0.25239 

0.60000 

0,36364 

7,0 

0,00000 

0.07355 

0,92645 

16,24 

0.10054 

0.90000 

0.90000 

1,0 

0,10893 

0.76214 

0.10893 

24,63 

0.09490 

0.90000 

0.81818 

2,0 

0,01729 

0,67792 

0.30479 

24,19 

0.02273 

0.90000 

0.75000 

3,0 

0,00306 

0.49590 

0.50102 

23.71 

0.77000 

0.90000 

0.69231 

4,0 

0,00062 

0.33945 

0,65993 

22,92 

0.69604 

0.90000 

0,64286 

5,0 

0,00014 

0.22567 

0.77419 

21.60 

0.50900 

0.90000 

0.60000 

6,0 

0,00004 

0.14891 

0.85106 

20,71 

0.47706 

0.90000 

0,56250 

7,0 

0.00001 

0.09890 

0.90119 

19,66 

0.37700 
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It  is  interesting  to  note  that  the  deviations  of  actual  test 

properties  from  the  desired  test  properties  over  the  range  of  Pj 

and  p2  are  remarkably  small  (when  compared  with  other  truncated 

sequential  and  fixed  size  tests  of  such  hypotheses)  . This  is 

especially  true  when  the  probability  of  continuation  to  trial  nQ 

(i.e.,  P (C  n))  is  not  too  large. 
n0“i 

If  the  actual  error  probabilities  are  not  satisfactory, 
there  are  two  possible  solutions  to  the  problem.  First,  modifi- 
cation of  the  truncation  rules  at  trial  nQ  can  be  used  to  adjust 
the  error  probabilities,  as  discussed  in  Section  3.5.  Also,  one 
might  try  using  different  values  for  a and  b,  which  are  used  in 
(4.15)  to  develop  the  sequential  test  regions.  The  exact  test 
properties  are  easy  enough  to  compute  (especially  in  this  special 
case),  so  that  one  can  use  a trial  and  error  method  to  obtain  the 
desired  results.  An  example  of  this  procedure  is  given  in  the 
next  section,  along  with  a comparison  of  the  tests  given  here  with 
other  tests  which  have  been  proposed  for  testing  the  same  hy- 
potheses. Further  discussion  of  this  topic  is  contained  in 
Chapter  7. 

5.4  FURTHER  NUMERICAL  EXAMPLES  AND  COMPARISON  WITH  OTHER 
SIMILAR  TESTS 

This  section  presents  two  further  numerical  examples. 

The  first  example  is  compared  with  a similar  fixed  size  test; 
the  second  is  compared  with  a similar  sequential  test. 
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Table  5.6  gives  the  test  properties  of  a sequential  test 
for  the  equality  of  two  unknown  binomial  proportions,  testing 
the  hypotheses 

Hl:  ^2=1/9.3333 

versus  H^:  t=tg=l  (5.20) 

versus  1^:  t=t2=9.3333 

with  specified  desired  error  probabilities  a1=a2=0.023  and 
6^=B2=0*35.  The  test  is  truncated  at  trial  25.  The  sequential 
test  region  for  this  test  can  be  found,  as  explained  above,  by 
using  the  computer  program  given  in  the  Appendix.  Table  5.7 
compares  the  power  and  ASN  functions  of  this  test  with  the  power 
function  of  the  UMPUT  fixed  size  test  with  sample  size  n*=15 
(i.e.,  15  pairs  are  sampled).  The  power  of  the  latter  is  given 
by  Harkness  (1959). 

The  a error  probability  for  the  UMPUT  test  is  0.05  for  all 
values  of  Pi=P2*  For  sequential  test,  the  a error  probabilities 

vary  (for  the  combinations  of  p^  and  p2  shown  in  the  table)  from 
0.079  (when  p^=P2=0.1)  to  0.045  (when  p^=p2=0.5).  These  proba- 
bilities are  close  enough  to  0.05  to  facilitate  comparisons.  The 
power  of  the  sequential  test  (again  for  the  points  shown  in  the 
table)  is  seen  to  be  uniformly  higher  than  that  of  the  fixed  size 
sample  test.  Also,  for  most  of  these  points,  the  ASN  function  is 
less  than  15,  the  sample  size  of  the  fixed  size  test.  For  some 
combinations  of  the  values  of  p^  and  p2,  the  ASN  exceeds  15. 

This  occurs  when  p^  and/or  p2  approach  the  extreme  values  of  0 and  1 . 
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Table  5.6 

Three  Decision  p.cp. 
Example  Tost  Properties 


Pi 

P2 

t 

POlj) 

0.10000 

0.10000 

1.0 

0.07391 

0.10000 

0.01000 

9,3 

0.00249 

0.10000 

0.01000 

20,0 

0.00060 

0.20000 

0.20000 

1.0 

0.03957 

0.20000 

0.10000 

2,2 

0.00585 

0.20000 

0.03000 

9.3 

0.00053 

0.20000 

0.01000 

20,0 

0,00014 

0.30000 

0.30000 

1.0 

0.02776 

0.30000 

0.20000 

1.7 

0.00537 

0.30000 

0,10000 

3,9 

0,00039 

0.30000 

0.04000 

9,3 

0,00005 

0.30000 

0.02000 

JO." 

0.00001 

0.40000 

0.40000 

1,7 

0.02414 

0.40000 

0.30000 

1,6 

0.00573 

0.40000 

0.20000 

‘2,7 

0.00083 

0.40000 

0. 10000 

6.0 

0.00003 

0.40000 

0.07000 

9,3 

0.00001 

0.40000 

0,03000 

?0 , 0 

0.00000 

0.50000 

0.50000 

1.0 

0.02345 

0.50000 

0.40000 

1.9 

0.00603 

0.50000 

0.30000 

2.3 

0.00125 

0.50000 

0.20000 

4,0 

0,00016 

0.50000 

0.10000 

9.0 

0.00001 

0.50000 

0.10000 

9.3 

1.00000 

0.50000 

0.05000 

20.0 

0.00000 

0.60000 

0.60000 

1 • 0 

0.02414 

0.60000 

0.50000 

1.5 

0.00603 

0.60000 

0.40000 

2.2 

0.00139 

0.60000 

0.30000 

3.5 

0.00027 

0.60000 

0.20000 

6,0 

0.00003 

0.60000 

0.14000 

9,3 

0.00001 

0.60000 

0.07000 

20,0 

0,00000 

0.60000 

0.10000 

13.5 

0,00000 

0.70000 

0.70000 

1,0 

0,02776 

0.70000 

0.60000 

1,6 

0.00573 

0.70000 

0.50000 

2,3 

0.00125 

0.70000 

0.40000 

3.5 

0.00027 

0.70000 

0.30000 

5,4 

0.00005 

0.70000 

0,20000 

9,3 

0.09001 

0.70000 

0.10000 

20,0 

0.00000 

0.70000 

0.10000 

21,0 

0,00000 

0.80000 

0.80000 

1.0 

0.03957 

0.80000 

0.70000 

1.7 

0.00537 

0.80000 

0.60000 

2,7 

0,00083 

0.80000 

0.50000 

4.0 

0.00016 

0.80000 

0.40000 

6,0 

0.00003 

0.80000 

0.30000 

9.3 

0.00001 

0.80000 

0.20000 

16,0 

0,00000 

0.80000 

0.17000 

2o.o 

0.00000 

0.80000 

0,10000 

36.0 

0.00000 

0.90000 

0,90000 

1, 0 

0.07391 

0.90000 

0.30000 

2.2 

0.00565 

0.90000 

0.70000 

3.9 

0.00039 

0.90000 

0.60000 

6,0 

0.00003 

0,90000 

0,50000 

9,0 

0,00001 

0.90000 

0.49000 

9.3 

0.00000 

0.90000 

0.40000 

13,5 

20,o 

0,00500 

0,90000 

0,31000 

0,00000 

0.90000 

0,30000 

2i,o 

0.00000 

0.90000 

0.20000 

36,0 

0,00300 

0.90000 

0.10000 

61,0 

0.00000 

P(l!0) 

p(n2) 

A5N 

P(Cn  -1 
0 

0.85218 

0.07391 

19.96 

0.42634 

0.43365 

0 . 56366 

24.11 

0.87071 

0.35319 

0 . 64621 

24.51 

0.92366 

0.921)09 

U. 03953 

14.44 

0 • 15615 

0.75036 

0.24379 

18.42 

0.37453 

0.27803 

0.72144 

22.41 

0.65125 

0.14939 

0,65047 

22,77 

Q.66/91 

0.94477 

0.02747 

11.03 

0.05669 

0.86526 

0 .12935 

13,26 

0.13772 

0.52511 

0 .47451 

17.46 

0.33221 

0.20117 

0 . 79878 

19.21 

0.37420 

0.07798 

0.92201 

19.17 

0.32638 

0.95244 

0.02342 

9.44 

0.02744 

0.90627 

0 . 08800 

10.64 

0.06025 

0.71763 

0.28154 

13.17 

0.15005 

0,32106 

0 .67869 

15.70 

0.21608 

0.17220 

0 . 62780 

15,91 

0.19147 

0.05051 

U . 94949 

15.39 

0 .12/44 

0.95406 

0. 02250 

b . 96 

0 .02004 

0 . 9lbl o 

0.07587 

9.56 

0.0381  7 

0 . 78661 

0 . 21214 

11.15 

0.08657 

0.52146 

0.47837 

12.95 

0.13282 

0.1  7633 

0 . 82367 

13.37 

0.10083 

0.16630 

0 . 63369 

13.34 

0 . 09797 

0.043B8 

0 . 95612 

12.44 

0.04612 

0,95244 

0.02342 

9.44 

0.02744 

0.91810 

0 . 07587 

9.56 

0.03807 

0.80251 

U.  19611 

10.55 

0.07084 

0.59350 

0 . 40624 

11.73 

0.09964 

0.32231 

0.67766 

12.16 

0.08726 

0.16557 

0.83442 

11,69 

0.05500 

0.04303 

0.95697 

10.44 

0.01689 

0.08804 

0.91196 

11,08 

0.03222 

0.94477 

0.02747 

11.03 

0.05669 

0.90627 

0. 08800 

10.64 

0.06025 

0.78661 

0,21214 

11.15 

0.08657 

0.59350 

0 . 40624 

11.73 

0-09964 

0.36616 

0.63379 

11,74 

0.08043 

0.16641 

U . 83358 

10.85 

0.03824 

0,04416 

0.95584 

9.27 

0.00711 

0,04038 

0.95962 

9.18 

0.00629 

0.92089 

0.03953 

14.44 

0.15615 

0.86528 

0.12935 

13,26 

0.13772 

0.71763 

0.28154 

13.17 

0.15005 

0.52146 

0.47837 

12,95 

0-13282 

0,32231 

0.67766 

12.16 

0.08726 

0.16641 

0.83358 

10.85 

0.03824 

0.06793 

0 . 93206 

9.28 

0.00882 

0.04609 

0.95391 

8,75 

0-00432 

0.01592 

0,96408 

7.72 

0.00056 

0.85218 

0,07391 

19,96 

0.42634 

0,75036 

0.24379 

18,42 

0-37453 

0,52511 

0.47451 

17.46 

0.33221 

0.32108 

0 .67889 

15.70 

0.21608 

0.17633 

0,82367 

13,37 

0.10083 

0.16616 

0.83384 

13,15 

0.09244 

0.08604 

0.91196 

11.06 

0.03222 

0.04397 

0.95603 

9,36 

0.00767 

0.04038 

0.95962 

9.18 

0.00629 

0,01592 

0.98408 

7.72 

0.00056 

0.00375 

0.99625 

6,55 

0.00001 
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Table  5.7 

Comparison  with  Fixed  Size  Test 


pl 

P2 

t 

P15(V 

Ps(Ha> 

.1 

.1 

1.00 

0.0500 

0.1472 

.2 

.2 

1.00 

0.050G 

0.0791 

.2 

.1 

2.25 

0.1040 

0.2496 

.3 

.3 

1.00 

0.0500 

0.0552 

.3 

.1 

3.85 

0.2535 

0.4749 

.4 

.4 

1.00 

0.0500 

0.0476 

.4 

.1 

6.00 

0.4646 

0.6789 

.5 

.5 

1.00 

0.0500 

0.0459 

.5 

.1 

9.00 

0.6820 

0.8237 

.6 

.6 

1.00 

0.0500 

0.0476 

.6 

.2 

6.00 

0.6095 

0.6777 

.7 

.7 

1.00 

0.0500 

0.0552 

.7 

.2 

9.33 

0.8020 

0.8336 

.8 

.8 

1.00 

0.0500 

0.0791 

.8 

.3 

9.33 

0.8020 

0.8336 

.9 

.9 

1.00 

0.0500 

0.1473 

.9 

.5 

9.00 

0.6820 

0.8237 
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ASN 


19.96 

14.44 

18.42 

11.03 

17.46 

9.44 

15.70 

8.96 

13.37 

9.44 

12.16 

11.03 

10.85 

14.44 

10.85 

19.  16 
13.37 
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Overall,  however,  the  sequential  tests  seems  superior  to  the 
fixed  size  test. 

Table  5.8  gives  the  test  properties  of  another  numerical 
example  for  this  same  problem.  The  specified  desired  error 
probabilities,  however,  have  been  changed  to  ot^c^^O.OS  and 
81=62=0*2.  The  test  is  still  truncated  at  trial  25.  Table  5.9 
compares  the  properties  of  this  test  with  those  of  Test  Plan  #4 
from  the  Ph.D.  dissertation  of  Oksoy  (1972) . His  is  also  a test 
for  the  equality  of  two  unknown  binomial  proportions  but  is  based 
on  the  statistic  D=x-y  (the  difference  between  the  number  of  suc- 
cesses in  the  two  populations,  which  is  not,  in  general,  a suf- 
ficient statistic)  and  the  test  is  truncated  at  trial  30. 

While  uniform  superiority  cannot  be  claimed  for  the  new 
sequential  test  presented  here,  it  appears  that  for  most  points 
in  the  (Pi»P2^  parameter  space,  it  will  offer  considerable  advan- 
tage. The  new  test  seems  to  have  better  properties  over  a wider 
range  of  the  values  of  p^  and  p2«  The  test  of  Oksoy  outperforms 
the  new  test  in  two  parts  of  the  (p^p,)  parameter  space.  The 
first  is  where  the  differences  between  p^  and  p2  are  very  large 
(e.g.,  .5  vs.  .9  and  . 8 vs . .3).  The  advantage  with  respect  to 
the  power,  in  this  part  of  the  (p^,p2)  space,  however,  is  not 
large.  The  test  of  Oksoy  is  also  superior  with  respect  to  the 
ex  error  probabilities  for  values  of  p^=p2  which  are  small.  This, 
however,  results  in  a corresponding  loss  of  power  for  his  test 
for  values  of  p^  and  p2  which  differ  much  with  respect  to  the  odds 
ratio,  but  little  with  respect  to  the  difference  A=p^-p2  between 
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Table  5.8 

I Three  Decision  Pi^P, 

Example  Test  Properties 


Pi 

p2 

t 

PlHj) 

P(H0) 

p(h2) 

ASN 

"'V> 

0.10000 

0.10000 

1.0 

0.10857 

0.78285 

0.10857 

21.72 

0.61937 

0.10000 

0.01000 

9.  J 

0.00253 

C. 40202 

0.59545 

24.50 

0.91599 

0.10000 

0.01000 

20.0  ' 

0.00061 

0.33603 

0.66336 

24.55 

0.91927 

0.20000 

(1.20000 

1.0 

0.06858 

0.86264 

0.06858 

15.76 

0.22288 

0.20000 

C. 10000 

2.2 

0.01145 

0.64912 

0.33943 

19.34 

0.44272 

0.20000 

0.03000 

9.3 

0.00062 

0.19243 

0. 80696 

21.56 

0.56303 

0.20000 

0.01000 

20,0 

0,00015 

0.09952 

0.90033 

21.42 

0.52571 

0.30000 

0.30000 

1.0 

0.04932 

0.90135 

0.04932 

12.09 

0.08025 

0.30000 

0.20000 

1.7 

0.01154 

0,79729 

0,19117 

14,25 

0.17222 

0.30000 

0.10000 

3.9 

0.00103 

0.41986 

0.57911 

17.33 

0.31627 

0.30000 

0.04000 

9,3 

0.00009 

0.13157 

0.86834 

17.72 

0.27963 

0.30000 

0.02000 

20,0 

C.  00002 

0.04303 

0.95695 

17.11 

0.208)0 

0.40000 

O.'OOOO 

. l-o 

0.04407 

0.91186 

0.04407 

10.39 

0.03611 

0.40000 

0.30000 

1.6 

0.01275 

0.85129 

0.13596 

11.48 

0.07332 

0.40000 

0.20000 

2.7 

0.00235 

0.62853 

U. 36912 

13.54 

0.15923 

0.40000 

0.10000 

6,0 

0.00014 

0.23957 

0.76029 

14,82 

0.17829 

0.40000 

0.07000 

9.3 

0.00003 

0.11731 

0,88266 

14.48 

0.13705 

0.40000 

0.03000 

20.0 

0.00000 

0.02978 

u. 97022 

13.51 

0.07306 

0.50000 

0.50000 

1.0 

0.042S3 

0.91435 

0.04283 

9.93 

0.02671 

0.50000 

0.40000 

1.5 

0.01385 

0.86801 

0,11814 

10.42 

0.04337 

0.50000 

0.30000 

2.3 

0.00369 

0.71030 

0 , 28b01 

11.61 

0.08925 

0.50000 

0.20000 

4.0 

0,00065 

0.42926 

0. 57009 

12. 6« 

0.12312 

0.50000 

0.10000 

9.0 

0.00004 

0.12490 

0.87507 

12.11 

0.07488 

0.50000 

0.10000 

9.3 

0.00003 

0,11709 

0,88287 

12.05 

0.07189 

0.50000 

0.05000 

20-0 

0,00000 

0.02790 

0.97210 

10.88 

0.02606 

0.60000 

0.60000 

1.0 

0.04407 

0.91186 

U. 04407 

10.39 

0.03611 

0.60000 

0.50000 

1,5 

0.01385 

0.86801 

0.11814 

10.42 

0.04337 

0.60000 

0.40000 

2,2 

0.00419 

0.73252 

0.26328 

11.08 

0. 07070 

0.60000 

0.30000 

3.5 

0.00109 

0.50799 

0.49092 

11.62 

0.00889 

0 . 6000o 

0.20000 

6.0 

0.00019 

0.24646 

0.75135 

11.25 

0.06971 

0.60000 

0.14000 

9.3 

0.00004 

0.11792 

0.88204 

10.40 

0.04045 

0.60000 

0.07000 

20,0 

0.00000 

0.02818 

0.97182 

9 02 

0.01011 

0.60000 

0.10000 

13,5 

0.00001 

0.05972 

0 94027 

9.67 

0.02174 

0.70000 

0.70000 

1.0 

0,04932 

0.90135 

0 J4932 

12.09 

0.08025 

0.70000 

0.60000 

1,6 

0.01275 

0.85129 

0.13596 

11.48 

0.07332 

0.70000 

0.50000 

2,3 

0.00369 

0.71030 

0 . 28601 

11.61 

0.08925 

0.70000 

0,40000 

3,5 

0.00109 

0.50799 

0.49092 

11.6? 

0.06889 

0.70000 

0.30000 

5,4 

0.00027 

0.28985 

0.70987 

10. V6 

0.06176 

0.70000 

0.20000 

9,3 

0,00005 

0.11760 

0,66236 

9.55 

0.02519 

0.70000 

0.10000 

20,0 

0.00000 

0.02791 

0.97209 

7.83 

0.00413 

0.70000 

0.10000 

21,0 

0.00000 

0.02541 

0,97459 

7.75 

0.00363 

0 . 00000 

o.eoooo 

1.0 

0.06858 

0.86284 

0,06858 

15.78 

0-22286 

o.eoooo 

0.70000 

1.7 

0.01154 

0.79729 

0,19117 

14.25 

0.17222 

0.80000 

0.60000 

2.7 

0.00235 

0.62853 

0.36912 

13.54 

0-15923 

0.80000 

0.50000 

4,0 

0.00065 

0.42926 

0.57009 

12.64 

0-12312 

0.80000 

0,40000 

6,0 

0.00019 

0.24646 

0.75135 

11.25 

0.06971 

o.eoooo 

0.30000 

9.3 

0.00005 

0.11760 

0.88236 

9,55 

0.02519 

0.80000 

0,20000 

16,0 

0,00001 

0.04221 

0.95778 

7.83 

0.00461 

0.80000 

0.17000 

20,0 

0,00000 

0.02727 

0.97272 

7.30 

0.00206 

0 80000 

0.10000 

J6.0 

0.00000 

0.00855 

0,99145 

6,33 

0.00023 

0.90000 

0.90000 

1,0 

0.10857 

0.78285 

0.10857 

21.72 

0.61937 

0.90000 

o.eoooo 

2,2 

0.01145 

0.64912 

0.33943 

19.34 

0.44272 

0.90000 

0.70000 

3,9 

0,00103 

0.41986 

0.57911 

17,33 

0.31627 

0.90000 

0.60000 

6,0 

0,00014 

0.23957 

0.76029 

14.82 

0.17829 

0.90000 

0.50000 

9.0 

0.00004 

0.12490 

0.87507 

12,11 

0 . 07488 

0.90000 

0.49000 

9.3 

0,00003 

0.11723 

0.88274 

11,87 

0.06806 

0.90000 

0.40000 

13,5 

0,00001 

0.05972 

0.94027 

9.67 

0.02174 

0.90000 

0.31000 

2o,o 

0,00000 

0.02797 

0.97202 

7.92 

0.00452 

0.90000 

0,30000 

21,0 

0.00000 

0.02541 

0,97459 

7,75 

0.00363 

0.90000 

0.20000 

36,0 

0.00000 

0.00855 

0.99145 

6.33 

0.00023 

0.90000 

0,10000 

81, 0 

0,0001)0 

0.00154 

0,99646 

5.27 

0.00000 
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Table  5.9 

Comparison  with  Oksoy  Plan  4 


r 

i 

pi 

P2 

t 

P*  (H  ) 

a 

p (HJ 

S a 

ASN* 

ASN 

i . 

.i 

.1 

1.00 

0.0090 

0.2172 

11 

21.70 

j 

.2 

.2 

1.00 

0.0586 

0.1372 

12 

15.78 

i. 

.2 

.1 

2.25 

0.0778 

0.3509 

13 

19.34 

.3 

.3 

1.00 

0.1159 

0.0987 

11 

12.09 

| . 

.3 

.1 

3.85 

0.3077 

0.5801 

14 

17.33 

.4 

.4 

1.00 

0.1544 

0.0881 

11 

10.39 

.4 

.1 

6.00 

0.6182 

0.7604 

13 

14.82 

.5 

.5 

1.00 

0.1675 

0.0857 

11 

9.93 

| 

.5 

.1 

9.00 

0.8848 

0.8751 

11 

12.11 

.6 

.6 

1.00 

0.1544 

0.0881 

11 

10.39 

1 

.6 

.2 

6.00 

0.8210 

0.7515 

10 

11.25 

1 

.7 

.7 

1.00 

0.1159 

0.0987 

11 

12.09 

, 

.7 

.2 

9.33 

0.9354 

0.8824 

8 

9.55 

.8 

.8 

1.00 

0.0586 

0.1372 

12 

15.78 

.8 

.3 

9.33 

0.9354 

0.8824 

8 

12.11 

i 

i 

.9 

.9 

1.00 

0.0090 

0.2172 

11 

21.70 

.9 

.5 

9.00 

0.8848 

0.8751 

11 

12.11 

mmmm 
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the  probabilities  (e.g.,  .2  vs.  .1  and  .3  vs.  1.).  The  former, 
as  explained  in  Section  4.1  is  the  preferred  method  of  comparing 
unknown  proportions. 

The  ASN  functions  of  the  two  tests  do  not  differ  appreciably 
except  when  p^  and  a re  both  small  or  both  large,  in  which  case 
the  ASN  of  the  new  tesc  increases  considerably  (as  is  expected) , 
to  correct  for  the  lower  average  amount  of  information  obtained 
per  trial  for  such  values  of  p^  and  p^  . Similar  comparisons  can 
be  made  with  the  tests  proposed  by  Armitage  (1960),  which  are 
based  on  the  same  statistic,  D=x-y.  His  tests,  however,  are 
truncated  after  a fixed  number  of  untied  pairs  have  been  observed, 
causing  the  ASN  to  be  extremely  large  for  values  of  P1=P2  which 
are  close  to  0 or  1. 

From  these  comparisons,  it  seems  reasonable  to  conclude  that 
the  new  tests  given  here  have  a decided  advantage  when  using 
such  sequential  tests  and  when  the  sample  sizes  will  generally  be 
small.  This  will  be  especially  true  when  extreme  values  of  p^ 
and  P2  can  be  expected,  for  which  larger  samples  are  necessary  for 
the  central  limit  theorem  to  become  applicable,  allowing  the  simpler 
statistic  of  Armitage  and  Oksoy  to  become  acceptable  for  such  tests. 
In  any  case,  the  new  test  will  not  be  any  worse  than  tests  which 
do  not  use  a sufficient  statistic. 
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CHAPTER  6 

ESTIMATING  PARAMETERS  OF  A 2x2  CONTINGENCY 
TABLE  AFTER  A SEQUENTIAL  TEST 


A3 


) 


6.0  INTRODUCTION 

Often,  after  completion  of  sequential  tests  of  hypoth- 
eses, it  is  desirable  or  necessary  to  estimate  the  parameters 
in  question.  This  subject  is  treated  here.  The  general  method 
of  estimation  used  here  is  due  to  Goss  (1974a)  and  Schmee  (1974). 
Some  of  the  preliminaries  for  the  material  presented  here,  in- 
cluding a brief  history  of  sequential  estimation,  an  explana- 
tion of  the  general  method  of  estimation  given  by  Schmee  and 
Goss,  and  a section  describing  the  interpretation  of  these  esti- 
mates, is  contained  in  Meeker  (1975)  and  will  be  referred  to 
below.  The  first  section  of  this  chapter  reviews  the  estimation 
of  the  binomial  parameter,  p,  as  treated  by  Goss  (1974a)  . 

Section  6.2  applies  the  general  method  to  estimation  of  the 
parameters  of  2x2  contingency  tables.  The  last  section  illus- 
trates the  procedures  with  a numerical  example. 

6.1  ESTIMATION  IN  THE  BINOMIAL  CASE 

The  following  is  a development  of  the  posterior  distribution 
and  estimation  procedures  for  the  binomial  distribution  parameter  p, 
For  the  cases  considered  here  (although  it  is  not  true  in  general) 
the  estimates  will  be  independent  of  the  stopping  rule;  that  is. 
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the  estimates  (and  confidence  intervals)  will  depend  only  on 
the  observed  data  at  the  termination  of  the  test,  and  do  not 
depend  on  the  particular  stopping  rules  (except  that  the  stop- 
ping rules  dictate  where  the  sequential  test  may  terminate) . 

The  probability  mass  function  of  the  binomial  distribution 


:'n'P)=  (x) 


px(l-p)n_x 


(6.1) 


Following  Goss  (1974a)  and  the  general  procedure  outlined  in 
the  preliminaries,  the  likelihood  of  a sample  point  (n,x) 

(i.e.,  of  the  observed  data)  at  the  termination  of  a sequential 
test  is 


bg (x,p,n)=K(n,x)pX(l-p)n-x 


(6.2) 


where  K(n,x)  is  the  number  of  admissible  paths  from  the  origin 
(0,0)  to  the  point  (n,x).  The  posterior  distribution  of  p 
(assuming  a uniform  (0-1)  prior)  is  then 


G (p,x,n)=  — ? — 
o' bS 


bg (x,p,n) 


3x(l-p)n~x 


/1bc (x,q,n)dq  /qX(l-q)n  xdq 


(6.3) 


From  the  posterior,  one  can  find  a point  estimate  of  a 
parameter  by  using,  for  example,  the  mean  of  the  distribution. 

The  expected  value  of  p with  respect  to  the  posterior  distribution 


p=E (p) =Qf  p-G  (p,n,x)dp 


(6.4) 


The  complete  beta  function  is  defined  as 
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B{a,b)=n/1qa"1a-q)b"1dq  = ( r (a)  r (b) ) / !’  (a+b)  (6.5) 


where  r(‘)  is  the  well-known  gamma  function  and  r(k+l)=k!  for 
integer  k.  From  this  (6.4)  reduces  to 


~ B (x+2,n-x+l)  /..iv/,  , 

B(x+l'n-x+l)  ' (x+l)/(n+2) 


(6.6) 


Confidence  intervals  (with  a Bayesian  interpretation)  can  be 


constructed  by  finding  values  p and  p such  that 


/PG (p,x,n)dp=l-a 


giving  a 100(l-a)%  confidence  level 


(6.7) 


The  upper  and  lower  confidence  limits  p and  p can  be  chosen 
in  a number  of  different  ways.  If  a one-sided  interval  is 
desired,  ^=1  or  p=0  for  a lower  and  upper  tailed  one-sided  inter- 
val respectively.  For  a two-sided  interval,  the  values  can  be 
chosen  to  minimize  the  interval  length  p-p  or  to  have  equal  prob- 
ability (a/2)  in  each  tail  of  the  posterior  distribution. 

By  using  the  incomplete  beta  distribution  function, 


I (a,b)=(l/B(a,b) ) /p q3"1 (1-q ) b_1uq 


(6.8) 


(a  very  thorough  treatment  of  this  function  is  given,  for  example, 
by  Abramowitz  and  Stegun  (1965)  and  Johnson  and  Kotz  (1971)),  the 
values  p and  p are  easily  found.  If 


then 


Ip (a,b)=Y 


p=l"1(a,b) 


(6.9) 


is  the  inverse  beta  distribution  function  and  p is  the  100 y 
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percentile  of  the  distribution.  An  equal  tailed  100(l-u)% 
confidence  interval  can  be  found,  for  example,  by 


p=l”^2  (x+l,n-x+l) 
'P=Il-a/2  (x+1'n-x+1) 


(6.10) 


6.2  ESTIMATION  OF  THE  PARAMETERS  OF  A 2x2  CONTINGENCY  TABLE 


This  section  treats  the  estimation  of  the  parameters  of  a 
2x2  contingency  table;  the  estimation  is  to  be  performed  at  the 
completion  of  a sequential  test.  The  estimation  procedure,  a 
Bayesian  approach,  is  based  on  the  general  method  given  by  Goss 
(1974a)  and  Schmee  (1974)  and  in  particular,  its  application  to 
the  binomial  distribution,  as  described  in  the  previous  section. 

The  underlying  probability  model  of  a 2x2  contingency  table 
with  both  margins  random  (and  the  probability  mass  functions 
assumed  to  be  unknown)  is  the  multinomial  distribution  shown  in 
(3.1).  The  observed  data  from  such  a 2x2  contingency  table  and 
the  corresponding  probabilities  are  shown  in  Figures  3.2  and 
3.1  respectively. 

The  multinomial  probability  mass  function  in  (3.1)  can  be 
factored  as  follows. 

PF(x,n1  ,n  1,n)=  (6.11) 

b(n1  ^ ,n)b(x,p1,n1  )b(n  1~x,p2,n-n;L  ) 
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where  b(x,p,n)=  ^ ^ pX  (l-p)n  X is  the  binomial  distribution 


and 


prpn/pi. 

p2=(p.rpn)/(1-pi.) 


(6.12) 


are  the  conditional  (on  the  right-hand  margin  (n.  ) of  Figure 
3.2)  probabilities  for  each  of  the  rows. 

Because  (3.1)  factors  exactly  into  the  binomial  distribu- 
tions in  (6.11),  the  three  parameters  p^ , p2  and  , which 
completely  describe  the  state  of  nature,  can  be  estimated  inde- 
pendently. Also,  p^  and  p2  are  often  more  important  than  the 
individual  cell  probabilities  within  the  table,  as  their  equality 
signifies  independence  of  the  row  and  column  characteristics 
being  observed.  Lindley  (1964)  uses  similar  factorization  for 
Beyesian  analysis  of  general  RxC  contingency  tables. 

Using  the  above  and  the  results  presented  in  Section  6.1,  one 
can  find  estimates  and  confidence  intervals  for  these  three  param- 
eters of  a 2x2  contingency  table.  Estimates  (i.e.,  the  expected 
value  with  respect  to  the  posterior  distribution)  for  the  three 
independent  parameters  in  (6.11)  are 

P1  =*nl  +1)/(n+2) 

P1  = (x+1)/ (nx  +2) 

P2  = (n  j-x+D/fn-nj.  +2). 


(6.13) 
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Using  the  inverse  incomplete  beta  distribution  as  in  (6.10), 
one  can  find  (independent)  Bayesian  confidence  intervals  for 
each  of  these  parameters.  For  example, 

Pl=Ia/2(x+1'nl."x+1)  (6.14) 

'jSl=Il-a/2(x+1'nl._J‘+l> 

give  the  upper  and  lower  limits  for  a two-sided  lOO(l-ot)?. 

Bayesian  confidence  interval  for  p^.  This  can  be  done  in  a 
similar  manner  for  p2  and  p^  . 

Because  of  the  independence  of  the  three  binomial  distribu- 
tions in  (6.11),  simultaneous  confidence  intervals  for  these 
parameters  can  easily  be  found.  For  example,  in  order  to  find 
a joint  100(l-a)%  confidence  region  for  all  three  of  the  param- 
eters, one  should  choose  the  confidence  level  for  each  individual 
interval  to  be  100 (1-y^),  i=l,3  such  that 

a=l=n (l-yi) . (6.15) 

The  estimation  procedure  for  the  binomial  distribution  is 
easily  generalized  to  treat  the  individual  probabilities  of  the 
multinomial  distribution  of  the  2x2  contingency  tables  considered 
here.  The  expected  value  (with  respect  to  the  posterior  distribu- 
tion) of  the  probability  of  a given  cell  of  the  multinomial  dis- 
tribution (assuming  a uniform  (0-1)  prior  distribution)  can  be 
shown  (>  nr  . (1975)  and  Good  (1965))  to  reduce  to 

a=  ' •;+!)/  (n+k)  (6.16) 


where  x is  the  observed  count  in  the  cell  being  considered,  n is 


■imiiaiium i,  u M»p-I  Iiiiuin  ■•n—ii 
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the  sample  size  and  k is  the  number  of  cells  in  the  multinomial 
distribution.  Equation  (6.6),  for  the  binomial  distribution, 
can  be  seen  to  be  a special  :ase  (i.e  , k=2)  of  (6.16). 

The  above  can  be  used  to  obtain  point  estimates  of  each  of 


the  cell  probabilities.  Letting  IK,  i=l,4  equal  the  individual 


probabilities  of  the  cells  shown  in  Figure  3.1,  these  estimates 
are 


n]=(x+l)/(n+4) 


n2=(ni  -x+1)/ (n+4) 


n3=(n  1~x+l)/ (n+4) 


(6.17) 


n4=(n-n1  -n  1+x+l)/(n+4) 


Bayesian  confidence  intervals  for  the  individual  cell  prob- 
abilities can  be  constructed  in  a manner  analogous  to  that  for 
the  binomial  distribution,  treated  in  the  previous  section.  For 


example,  a 100(l-a)%  upper  confidence  limit  for  is 


ni=I1^ct^2  (x+1 , n-x+4) 


(6.18) 


Upper  and  lower  confidence  limits  for  the  other  parameters  are 
similarly  constructed.  This  is  done  as  follows: 


r-l 


n =1  (x+l,n-x+l) 

— 1 a/2 


r-1 


^2=1l-a/2^nl  -x+l'n_ni  +x+4) 


(6.19) 


S2=Ia/2(nl."X+1'n‘nl.+x+4) 


— ■ — — . 
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VIi-«/2(n.rx+1'n-n.i+x+4> 

A3=Ia/2(n.rxtl'n'n.i+xt4) 

1r4'1i-c./2(n-nl.-n.l+x+1'nl.+n.rx+‘l) 

n.sl”1,,,  (n-n.  -n  ,+x+l,n,  +n  ,-x+4) 

^ 4 Qt/ 2 1 • i 1 X*  • X 

6.3  NUMERICAL  EXAMPLE  OF  THE  ESTIMATION  PROCEDURE 

Suppose  that  a sequential  test  is  terminated  at  trial  25 
with  the  observed  data  shown  in  Figure  6.1. 


x=8 

2 

n.  =10 

X • 

7 

8 

15 

n , =15 

• X 

10 

n=25 

Figure  6.1  Observed  Data  from  a 2x2  Table 


The  estimates  and  90%  confidence  intervals  for  the  parameters 
of  this  example  are  shown  in  Table  6.1. 


Table  6.1 

Point  Estimates  and 
90%  Confidence  Limits 


Estimate 

pi  0.407 
pi  0.750 
p2  0.471 
HI  0.310 

112  0.103 

113  0.276 
ri4  0.310 


Lower  Limit 

0.234 

0.484 

0.248 

0.197 

0.039 

0.168 

0.197 


Upper  Limit 

0.593 

0.939 

0.700 

0.409 

0.173 

0.372 

0.409 
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CHAPTER  7 

CONCLUSION  AND  DISCUSSION  OF  POSSIBLE 
AREAS  FOR  FURTHER  RESEARCH 


7.0  INTRODUCTION 

This  chapter  begins  with  a brief  review  of  the  models  which 
can  be  formulated  in  terms  of  a 2x2  contingency  table.  This  is 
followed  by  a discussion  of  some  possible  refinements  and  areas 
for  further  research,  and  some  concluding  remarks. 

7.1  REVIEW  OF  2x2  CONTINGENCY  TABLE  MODELS 

The  different  probability  models  which  can  be  formulated 
in  terms  of  2x2  tables  are  treated  at  some  length  in  Sections 

1.2  and  1.3.  There,  six  different  models  are  discussed.  These 
models  differ  with  respect  to  the  number  of  margins  which  are 
"observable"  (i.e.,  margins  which  can  be  controlled  by  the 
experimenter)  and  the  number  of  marginal  probability  distribu- 
tions which  are  known  (knowledge  of  the  probability  function  of 
a margin  which  is  controlled  by  the  experimenter,  of  course,  has 
r.o  additional  value).  These  six  models  are  depicted  in  Figure 
7.1  and  are  explained  below. 

Case  I This  model  is  used  when  both  marginal  totals  are 
random  variables  and  marginal  probability  distributions  are 
unknown.  Inferences  concerning  the  degree  of  dependence  (meas- 
ured by  the  cross  product  ratio)  are  made  conditional  on  the 
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# Margins  Which  Are  "Observable" 
0 12 


# Margins 
with  Known 
Marginal  . 

Probabil- 
ities 

2 

Figure  7.1  2x2  Contingency  Table  Models 

observed  values  of  the  ancillary  statistics,  the  marginal  totals. 
This  case  is  treated  in  Chapter  4. 

Case  II  This  model  differs  from  that  of  Case  I in  that  one 
of  the  marginal  populations  is  "observable."  That  is,  the  experi- 
menter can  choose  at  will  an  observation  from  either  category  of 
the  "observable"  population.  The  test  is  then  for  the  equality 
(or  some  degree  of  inequality)  of  two  unknown  binomial  propor- 
tions. Inferences  for  this  model  are  made  by  conditioning  on 
the  observed  value  of  the  ancillary  statistic,  which  is  the  total 
number  of  successes  for  both  populations.  This  model  is  treated 
in  Chapter  5 for  the  special  case  when  one  observation  is  taken 
from  each  population  at  each  stage  of  the  test  (a  common  sampling 
procedure).  The  method  given  there,  however,  is  general  and  can 
be  applied  to  other  problems  when  one  margin  is  controlled  in 
some  other  prespecified  manner. 

Case  III  In  this  model,  both  marginal  totals  can  be  fixed 
in  advance.  This  is  not  a commonly  used  model.  The  classic 
example  of  such  a test  is  Fisher's  tea-tasting  experiment,  briefly 


I 

II 

III 

IV 

V 

VI 
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mentioned  in  Section  1.3.  Sequential  applications  for  this  model 
seem  limited. 

Case  IV  This  model  occurs  when  both  marginal  totals  are 
random  variables  and  the  probability  distribution  of  one  of  the 
totals  is  known.  This  case  has  not  been  treated  here. 

Case  V When  one  marginal  population  is  "observable"  (i.e., 
can  be  controlled  by  the  experimenter)  and  the  other  marginal 
distribution  has  a known  probability  distribtion,  the  problem 
can  be  reduced  to  a simple  binomial  model  by  taking  all  observa- 
tions from  one  of  the  categories  of  the  "observable"  population, 
as  explained  in  Section  1.2.  Such  a procedure  gives  an  asymptot- 
ically most  powerful  test  (Lehmann,  1959). 

Case  VI  This  model  is  similar  to  that  of  Case  T except 
that  in  this  case  the  marginal  probability  distributions  are 
known.  The  null  hypothesis  of  independence  is  most  conveniently 
expressed  as 

Ho:  pu’pi.p.i  (7-1) 

There  are  no  nuisance  parameters  in  this  model  (p^  is  the  only 
unknown  parameter)  and  an  unconditional  test  of  the  hypothesis 
in  (7.1)  is  easily  found.  Sequential  methods  for  this  case  are 

1 

J 

l 

treated  in  Chapter  3. 

7.2  POSSIBLE  AREAS  FOR  FURTHER  RESEARCH 

I 

There  are  several  topics  related  to  the  above  results  which 
might  lead  to  further  research.  Some  of  these  are  briefly  out- 
lined below. 
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Evaluation  of  the  exact  properties  of  the  sequential  tests 
for  2x2  contingency  tables  which  are  given  in  Chapters  3 and  4 
involves  a large  amount  of  computation  when  the  test  is  not 
truncated  at  a relatively  small  sample  size.  This  problem  is 
less  severe  for  the  cases  treated  in  Chapter  5.  The  numerical 
examples  given  in  Chapters  3 and  4 were  truncated  at  trial  25. 
Truncation  at  larger  sample  sizes  was  not  feasible  because  of 
limitations  of  computer  memory  with  available  facilities.  With 
a medium  size  computer  (e.g.,  32k  words  of  memory),  it  would  be 
possible  to  run  cases  up  to  trial  100.  For  tests  requiring  sample 
sizes  which  are  much  larger  than  this,  some  other  methods  might 

be  developed.  Asymptotic  theory  might  be  of  some  assistance  here. 

2 

It  is  well  known  that  the  x distribution  can  be  used  to 
approximate  the  multinomial  distribution  associated  with  a con- 
tingency table  and  can  therefore  be  used  to  make  tests  of  signif- 
icance for  this  model.  The  observed  marginal  totals  are  used  to 

2 

estimate  the  marginal  probabilities  if  they  are  unknown.  The  x 
approximation  is  valid  when  the  expected  values  of  each  of  the 
contingency  table's  cells  is  of  sufficient  size  (usually  an  ex- 
pected value  of  5 is  specified,  although  some  argue  for  a lower 
value)  . 

2 

The  usual  x statistic  for  a general  RxC  contingency  table 
is  computed  as 


, R C 

•=  . E.  . (n.  .-E.  .r/E.  ■ 

1=1  D=1  ID  ID  ID 


(7.2) 


where  E. .=n.  n ./n  is  the  expected  value  (under  the  null  hypoth- 

1 j l . . j 

esis  of  independence)  of  cell  (i,j)  and 


n= 


(7.3) 


As  mentioned  in  Section  1.3,  a half  integer  continuity  correction 

2 

can  also  be  used  here.  The  x statistic  has  one  degree  of  free- 
dom for  cases  I,  II  and  III;  two  degrees  of  freedom  for  cases  TV 
and  V;  and  three  degrees  of  freedom  for  case  VI,  as  shown  in 
Figure  7.1. 

Harkness  (1959)  treats  the  asymptotic  power  of  such  tests. 

2 

He  shows  that  for  non-independent  2x2  tables,  the  x statistic 

2 

in  (7.1)  asymptotically  follows  a non-central  x distribution 
with  non-centrality  parameter 

{ . nPl_paU-pu/(Pi  pa))2  ,7.4) 

(d-Pl_)  n-pml)) 

(which  is  zero  under  the  null  hypothesis  of  independence) . 

For  sequential  analysis  of  2x2  contingency  tables  when  large 

sample  sizes  are  required,  it  would  be  reasonable  to  have  a 

test  procedure  based  on  a model  similar  to  this.  Such  a test 

might  be  based  on  the  non-centrality  parameter  (corrected  for  the 

2 

sample  size),  using  some  function  of  the  x statistic  in  (7.1) 
(corrected  for  the  sample  size  as  a test  statistic) . A reasonable 
statistic  might  be  the  phi  coefficient 

<*=(X2/n)*.  (7.5) 


Goodman  and  Kruskal  (1954)  give  an  account  of  this  statistic  as 
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a measure  of  association.  Such  a test  could  be  evaluated  using 

the  methods  given  in  Chapter  3,  still  leaving  the  computational 

difficulties  for  large  samples.  Approximate  properties  of  such 

tests  could  be  obtained  by  using  the  direct  method  to  evaluate 

2 

the  non-central  x distribution  under  sequential  test  rules  (such 

a procedure  has  not  yet  been  investigated)  or  with  Monte  Carlo 

2 

techniques.  Such  a test,  based  on  the  x statistic  (or  some 
function  of  it),  has  two  advantages: 

1.  The  test  statistic  has  only  one  dimension. 

2.  Results  could  be  easily  extended  to  general 

RxC  or  multidimensional  contingency  tables. 

2 

At  the  beginning  of  the  sequential  test,  when  the  x distribu- 
tion is  not  applicable  (say  for  n<25) , special  considerations 
must  be  used.  Two  possibilities  seem  reasonable: 

1.  Use  the  small  sample  procedures  given  above  for 
n<25 . 

2.  Do  not  allow  termination  of  the  sequential  test 
until  n=25,  or  until  the  expected  values  of  each 
of  the  cells  are  "large  enough." 

The  development  of  a test  procedure  similar  to  the  above 

would  be  valuable  in  situations  where  relatively  large  samples 

will  be  required  to  obtain  the  desired  test  properties. 

Finally,  it  should  be  pointed  out  that  the  results  in 

Chapters  3,  4 and  5 remain  valid  for  large  samples  (although  the 

2 

procedures  are  more  difficult  than  for  asymptotic  (e.g.,  x ) 


tests).  Also,  it  is  not  too  difficult  (given  a small  computer 
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program  like  the  one  listed  in  the  Appendix)  to  compute  the  indi- 
vidual critical  values  for  the  two  and  three  dimensional  test 
statistics  for  such  large  sample  sizes.  Tables  for  complete  plans, 
however,  would  be  quite  lengthy.  The  difficult  problem  is  in 
finding  the  exact  test  properties  for  tests  requiring  such  large 
samples . 

One  problem  which  has  arisen  with  the  use  of  sequential 
analysis  is  that  in  the  past  exact  test  properties  of  the  sequen- 
tial tests  were  unknown.  Researchers  and  experimenters  usually  hud 
to  rely  on  the  sometimes  crude  approximations  and  bounds  given  by 
Wald  (1947)  and  others.  For  cases  where  no  such  approximations 
are  available,  Monte  Carlo  techniques  have  been  used  (and  some- 
times misused) . The  direct  method  of  sequential  analysis  has  pro- 
vided a vehicle  for  overcoming  this  problem.  The  results  obtained 
thus  far  with  the  direct  method  of  sequential  analysis  (see  the 
references  given  in  Section  2.2)  have  been  substantial  and  have 
shown  that  the  Wald  regions  give  generally  good  results,  even  when 
the  sequential  test  is  terminated  at  or  near  the  sample  size  nec- 
essary for  a comparable  fixed  size  sample  test.  When  a given  test 
procedure  does  not  have  the  desired  test  properties,  the  direct 
method  can  be  used  to  evaluate  other  alternate  regions. 

Schmee  (1974)  uses  the  direct  method  in  the  presence  of  a 
nuisance  parameter.  In  his  treatment  of  the  sequential  t-test, 
o,  the  standard  deviation  of  the  normal  population,  is  a nuisance 
parameter.  As  explained  in  Chapters  4 and  5,  the  marginal  proba- 
bilities of  2x2  contingency  tables  are  nuisance  parameters  when 
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one  wishes  to  make  inferences  concerning  the  degree  of  dependence 
(i.e.,  inferences  concerning  t,  the  cross  product  or  odds  ratio). 

The  problem  in  the  present  case,  however,  is  somewhat  different 
than  that  of  the  sequential  t-test.  In  the  sequential  t-test, 

\ I 

the  parameter  under  test  is  d=y/o,  where  u is  the  mean  of  the  - i j 

normal  population.  The  test  properties  for  the  sequential  t-test 
will  be  exactly  the  same  for  equal  values  of  d,  irrespective  of 
the  actual  values  of  p and  o.  Th’ ..  is  the  property  of  invariance 
(Hall,  Wijsman  and  Ghosh,  1965).  This  is  not  true  in  the  case  of 
the  cross  product  (or  odds)  ratio  with  respect  to  nuisance  param- 
eter (s)  of  a 2x2  contingency  table.  That  is,  the  test  properties 
will  vary  over  the  parameter  space  for  equal  values  of  the  cross 
product  (or  odds)  ratio.  It  is  encouraging  to  note,  however, 
that  the  test  properties  do  not  vary  appreciably  when  the  proba- 
bilities of  continuation  for  a given  point  in  the  parameter  space, 
is  small,  as  shown  in  the  numerical  examples  of  Chapter  5.  This 
is  discussed  below. 

However,  for  certain  values  of  the  nuisance  parameters,  the 
test  properties  will  deviate  considerably  from  the  specified 
"desired"  error  probabilities.  It  is  sometimes  a problem  to  attain 
the  desired  error  probabilities  in  the  presence  of  such  nuisance 
parameters,  but  several  methods  of  approach  (all  relying  heavily 
on  the  direct  method  for  test  property  evaluation)  are  suggested. 

First,  one  can  modify  the  critical  values  (usually,  but  not 
necessarily  at  the  truncation  point,  n^)  to  favor  one  hypothesis 
or  the  other.  This  can  be  done  in  a systematic  manner  by  exam- 
ination of  the  probabilities  of  reaching  the  points  in  question 
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1 

(these  probabilities  are  available  from  the  direct  method) . 

Some  rules  of  thumb  can  be  devised  for  this  procedure  by  exam- 
ination of  the  distribution  of  the  ancillary  statistics  under 
states  of  nature  where  the  test  properties  need  to  be  changed. 

For  example,  if  one  desires  to  change  (for  the  most  part)  the 
probability  of  acceptance  of  one  hypothesis  or  another  in  a 
test  for  the  equality  of  two  unknown  binomial  proportions  (as 
treated  in  Chapter  5),  for  values  of  P1=P2  when  both  are  small, 
one  would  modify  the  truncation  rule  for  small  values  of  the 
ancillary  statistic  n . , the  total  number  of  successes  from  both 

• i- 

populations.  Such  a modification  will  have  very  little  effect 
on  the  test  properties  for  values  of  P1=P2  near  0.5.  This  pro- 
cedure is  easily  generalized  for  the  2x2  tables  treated  in 
Chapter  4.  Also,  such  modification  at  trial  nQ  will  have  the 
largest  effect  on  those  points  in  the  parameter  space  which  have 
the  largest  probability  of  continuation  at  trial  nQ-l.  It  must  be 
remembered  that  such  modification  will  result,  for  example,  in  a 
reduction  of  the  a error  probabilities,  with  a resulting  loss  in 
power  at  alternates  to  the  null  hypothesis;  the  hope  being  that 
the  relative  gain  will  exceed  this  loss.  Use  of  the  direct  method 
will  facilitate  such  modifications.  It  should  be  noted  that  mod- 
ification of  the  region  in  this  manner  will  not  affect  the  dis- 
tribution of  the  DSN  or  the  ASN  function. 

When  the  probability  of  continuation  at  trial  n^-1  is  small 
at  points  in  the  parameter  space  where  the  error  probabilities 
deviate  from  the  desired  values,  another  approach  may  have  to  be 
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used  (this  approach  may  be  the  best  in  any  case,  however).  This 
is  because  the  above  method  of  region  modification  will  have 
little  or  no  effect  on  the  error  probabilities. 

The  numerical  example  given  in  Table  5.8  shows  that  for 
most  points  in  the  (p^,p2)  parameter  space,  the  actual  8 error 
probabilities  are  considerably  less  than  the  specified  values 
(the  u error  probabilities,  for  most  points,  are  near  the  desired 
values).  For  most  of  these  points,  the  probability  of  contin- 
uation at  trial  n^-l  is  small.  This  indicates  that  it  would  be 
reasonable  to  change  the  values  with  which  the  likelihood  ratio 
is  compared  at  each  trial  (or  equivalently,  the  specified  "desired" 
error  probabilities)  in  order  to  achieve  the  desired  test  prop- 
erties. In  the  present  example,  one  would  allow  an  increase-  in  the 
8 error  probabilities  in  the  hope  of  making  some  gains  with  respect 
to  the  ASN  function.  Table  7.1  shows  the  test  properties  for  the 
same  example,  except  that  the  desired  error  probabilities  were 
specified  as  a^=a2=0.024  and  B^=B2=0-45.  The  resulting  test  prop- 
erties after  this  change  are  closer  to  the  original  desired  values 
and  the  ASN  function  has  decreased  somewhat.  This  procedure  could 
be  repeated  until  the  desired  error  probabilities  are  more  closely 
approached . 

For  certain  cases,  especially  for  extreme  values  of  the  nui- 
sance parameters  (e.g.,  when  it  is  necessary  to  discriminate  be- 
tween p^  and  p2  and  both  are  expected  to  be  small),  the  above 
regions  modification  procedures  may  not  be  able  to  give  satisfac- 
tory results.  In  such  cases,  it  will  be  necessary  to  increase  the 


Three  Decision  p =p. 
Example  Test  Properties 


pl 

p2 

t 

P(H1) 

P(H0) 

P (Up) 

ASN 

P(C  1 

"o'1 

0.10000 

0.10000 

iiO 

0.06929 

0,86143 

0,06929 

16,31 

0.33713 

0.10000 

0.01000 

9,3 

0.00249 

0.43891 

0.55860 

23.10 

0.63099 

0.10000 

0.01000 

20,0 

0,00060 

0.35594 

0.64345 

23.99 

0.90213 

0.20000 

0.20000 

1.0 

0,03587 

0 , 92b27 

0,03587 

11.67 

0.11396 

0.20000 

0.10000 

2,2 

0,00538 

0.78090 

0.21372 

14.93 

0.20146 

0.20000 

0.03000 

9,3 

0.00053 

0.32107 

0 .67841 

20,20 

0.55993 

0.20000 

0,01000 

20,0 

0,00014 

0.17677 

0,82309 

21.4i 

0.61114 

0.30000 

0.30000 

1.0 

0.02638 

0.94J25 

0 . 02638 

9.65 

0.0<162 

0.30000 

0.20000 

1,7 

0,00552 

0.87365 

0.12003 

11,16 

0.10159 

0.30000 

0.10000 

3.9 

0,00039 

0.57722 

0.42239 

14,60 

0.24689 

0.30000 

0.04000 

9,3 

0,00005 

0.26965 

0. 73031 

16.75 

0.29142 

0.30000 

0.02000 

20,0 

0,00001 

0.12729 

0,67270 

17.40 

0.27217 

0.40000 

0.40000 

1,0 

0,02544 

0,94913 

0 .02544 

6.82 

0-02034 

0.40000 

0.30000 

1,6 

0,00623 

0.90352 

0 , 09025 

9,64 

0.04460 

0.40000 

0.20000 

2.7 

0.00094 

0.  7?90D 

0 . 27006 

11 . 55 

0-11121 

0.40000 

0.10000 

6.0 

0,00004 

0,37472 

0.62524 

13.61 

0.16001 

0.40000 

0.07000 

9,3 

0.00001 

0.23343 

0,76656 

13,92 

0-14241 

0.40000 

0.03000 

20,0 

0.00P00 

0.09686 

0 . 9 C 1 1 4 

13.83 

0.09771 

0.50000 

0.50000 

1,0 

0,02456 

0 . 95  UB8 

0 . 02456 

8,58 

0.01746 

0.50000 

0.40000 

1,5 

0,00646 

0,91435 

0.07919 

V.  07 

0.03099 

0.50000 

0.30000 

2,3 

0.00136 

0 .78504 

u . 2 1 3 6 0 

10.36 

0.06/39 

0.50000 

0.20000 

4.0 

0.00018 

0.53489 

0.  46493 

11.76 

0 . 09986 

0,50000 

0.10000 

9.0 

0.00001 

0,21696 

0 . 78303 

12.05 

0.07447 

0.50000 

0.10000 

9,3 

0.00001 

0.20737 

0 . 79263 

12.03 

0 . 07233 

0.50000 

0.05000 

20,0 

0.00000 

0.07964 

0.92016 

11.38 

0.03406 

0.60000 

0.60000 

1,0 

0,02544 

0,94913 

0.02544 

8.82 

0.02084 

0.60000 

0.50000 

1,5 

0.00646 

0.91435 

0 . C 79 1 9 

9.07 

0.03099 

0.60000 

0.40000 

2,2 

0.00149 

0.79977 

0.19674 

10.03 

0.05946 

0.60000 

0.30000 

3,5 

0.00028 

0.59601 

0.40371 

11.06 

0.08175 

0.60000 

0.20000 

6,0 

0. 00003 

0.33647 

0.66349 

11.36 

0.06791 

0.60000 

0.14000 

9,3 

0,00001 

0.16761 

0,81238 

10.91 

0.04139 

0.60000 

0.07000 

20,0 

n, 00000 

0.06487 

0.93513 

9,84 

0.0123, 

0.60000 

0.10000 

13,5 

0,00500 

0.11195 

0.68805 

10.37 

0. 02303 

0.70000 

0.70000 

1.0 

0.02938 

0.94325 

0 , 02839 

9,65 

0.04162 

0.70000 

0.60000 

1,6 

0,00623 

0.90352 

0.09025 

9,64 

0.04460 

0.70000 

0.50000 

2.3 

0.00136 

0 . 76504 

0.21360 

10.36 

0.06739 

0.70000 

0.40000 

3,5 

0.00028 

0.59601 

U. 4Q371 

11,0  6 

0.08175 

0.70000 

0.30000 

5,4 

0,00005 

0.37262 

0.62733 

11.13 

0.06730 

0.70000 

0.20000 

9,3 

0,00001 

0.17621 

0 .62378 

10.31 

0.03100 

0.70000 

0.10000 

2o,o 

0,00000 

0,  05436 

0,94564 

8.90 

0.00535 

0.70000 

0.10000 

21,0 

O.OOrOO 

0.05042 

0 , 94957 

8.82 

0.00472 

o.eoooo 

0.80000 

1,0 

0,03587 

0.92827 

0.03587 

11.67 

0.11396 

o.eoooo 

0. 70000 

1,7 

0.00552 

0.87365 

0.12083 

11,13 

0.10159 

0.60000 

0.60000 

2,7 

0,00094 

0 . 72900 

0.27006 

11.55 

0.11121 

0.60000 

0.50000 

4,0 

0.00018 

0.53489 

0.46493 

11.76 

0-09986 

0.80000 

0.40000 

6,0 

0,00003 

0.33647 

0 . 66349 

11.36 

0-06793 

0.80000 

0.30000 

9.3 

0,00001 

0 . 1 7621 

0.62378 

10.31 

0.03100 

o.eoooo 

0.20000 

16.0 

0,00000 

0.07269 

0.92731 

0.90 

0.0072V 

o.eoooo 

0.17000 

20,0 

0.00000 

C , 04986 

0 . 95014 

8,42 

0 .00354 

0.80000 

0.10000 

46,0 

0,00000 

0.01640 

0 . 96160 

7.49 

0.00043 

0.90000 

0.90000 

1,0 

0,06929 

0 .86143 

0 . 06929 

16,31 

0-33713 

0.90000 

0.80000 

2,2 

0.00538 

0.78090 

0.21372 

14.93 

0.2014b 

0.90000 

0.70000 

3,9 

0,00039 

0.57722 

0 . 42239 

14.60 

0.24669 

0.90000 

0.60000 

6,0 

0.00004 

0.37472 

0.62524 

13.61 

0-16001 

0.90000 

0.50000 

°,0 

0.00001 

0 . 21696 

0 , 78303 

12,05 

0.0744/ 

0.90000 

0.49000 

9.3 

0.00001 

0.20529 

0 ,79470 

11.90 

0.06826 

0.90000 

0.40000 

13,5 

0.00000 

0.11195 

0 . 88805 

10.37 

0.02383 

0.90000 

0.31000 

20,0 

0.00000 

0.05519 

0,94481 

8,97 

0.00574 

0,90000 

0.30000 

21,0 

0.00000 

0.05042 

0 . 94957 

8,82 

0.00472 

0.90000 

0.20000 

46,0 

0,00030 

0 . 01840 

U . 98160 

7,49 

0.00043 

0.90000 

0.10000 

91,0 

0,00000 

0.00405 

0,99595 

6,40 

0.00001 

141 


142 


the  value  of  n^,  the  truncation  point  of  the  sequential  test. 

One  other  important  and  desirable  characteristic  of  the 
sequential  tests  with  nuisance  parameters  presented  here  is 
that  they  give  a method  of  obtaining  a test  procedure  which 
affords  approximately  equal  error  protection  against  specified 
(by  or  H^)  values  of  alternate  hypotheses  (the  hypotheses 
being  specified  in  terms  of  the  cross  product  (or  odds)  ratio) , 
with  a certain  amount  of  "invariance"  to  the  actual  values  of 
the  nuisance  parameter (s ) . For  example,  as  shown  in  Table  5.7, 
the  fixed  size  (UMPUT)  (see  4.10)  for  the  hypotheses  in  (5.12) 
has  a probability  of  rejecting  HQ  equal  to  0.05  for  all  P^=P2- 
For  equal  values  of  t other  than  one  in  the  (plfp2)  parameter 
space  (see  Figure  4.1),  however,  the  power  varies  considerably 
with  the  actual  values  of  the  nuisance  parameters. 

Because  the  amount  of  information  obtained  from  a given 
sample  depends  on  the  observed  values  of  the  ancillary  sta- 
tistic (s)  (whose  distribution  depends  only  on  the  values  of  the 
nuisance  parameter (s )) , there  is  no  fixed  size  test  procedure 
which  will  give  even  approximately  equal  protection  (with 
respect  to  the  power  function)  along  contours  of  equal  values 
of  t^l  in  the  (p^,p2)  parameter  space.  The  sequential  procedures 
presented  here  help  correct  for  this  and  the  power  function  of 
such  tests  will  be  relatively  constant  over  such  contours  in  that 
part  of  the  (p^,p2)  space  where  the  probability  of  continuation 

to  the  truncation  trial  nn  (P(C  _,))  is  small.  This  is  evidenced, 

u nQ  i 

for  example,  in  the  test  properties  of  the  numerical  examples  which 
are  given  in  Tables  5.6,  5.8,  and  7.1. 
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This  "invariance"  property  (which  is  not  invariance  in  the 
strict  sense  of  Hall,  Wijsman  and  Ghosh  (1965),  but  is  similar 
in  nature)  is  present  in  the  sequential  tests  for  the  2x2  con- 
tingency tables  treated  in  Chapter  4 as  well  as  for  those  treated 
in  Chapter  5. 

Another  area  for  possible  further  research  is  the  applica- 
tion of  some  of  the  above  results  with  respect  to  the  wide  variety 
of  other  statistical  problems  which  can  be  formulated  in  terms 
of  a 2x2  contingency  table.  Some  of  these  models  include  thr 
study  of  matched  proportions  in  crossover  designs  (Gart,  1969) 
and  the  study  of  Poisson  distributed  incidence  rates  (Gart,  1974). 
Also,  nonparametric  two-sample  tests  for  the  equality  of  medians 
can  be  formulated  in  terms  of  a 2x2  contingency  table  (Owen,  1962)  . 
The  methods  presented  here  might  be  used  in  two  ways  to  help  solve 
these  problems  sequentially.  That  is, 

1.  To  obtain  a SPRT  which  is  conditional  on  observed 
ancillary  statistic (s) , yielding  a test  based  on 

a sufficient  statistic  (which  is  usually  desirable) . 

2.  To  find  the  exact  test  properties  of  such  tests, 
based  on  evaluation  procedures  similar  to  those 
given  here. 

The  underlying  probability  distributions  of  these  models  are 
usually  somewhat  more  complex  (especially  under  alternatives  to 
the  null  hypothesis)  than  the  multinomial  and  binomial  distribu- 


tions considered  here. 


7.3  CONCLUSION 

X 


It  is  hoped  that  the  results  presented  here  will  be  valuable 
both  in  a practical  sense  and  as  a stimulus  toward  further  in- 
vestigation of  sequential  methods  for  related  problems.  Some 
new  methods  of  finding  sequential  test  regions  have  been  inves- 
tigated here.  In  addition,  methods  of  exact  evaluation  of  the 
properties  for  these  (and  other  similar)  tests  have  been  developed, 
enabling  the  experimenter  using  such  methods  to  know  more  pre- 
cisely the  size  of  the  risks  associated  with  a given  test  pro- 
cedure, and  to  help  one  find  the  best  test  procedure  for  the  prob- 
lem at  hand. 

The  results  presented  here  should  have  wide  applicability 
in  situations  where  it  is  difficult  or  expensive  to  obtain  ob- 
servations or  when  data  are  naturally  obtained  sequentially.  As 
shown  in  the  numerical  comparisons  given  in  Chapters  3,  4 and  5, 
the  sequential  tests  presented  here  are  clearly  superior  (with 
respect  to  expected  sample  size  requirements)  to  similar  fixed 
size  and  other  proposed  sequential  (in  the  case  of  the  comparison 
of  two  unknown  binomial  proportions)  procedures,  allowing  sig- 
nificant savings  with  respect  to  the  necessary  time  and/or 
expense  associated  with  sampling. 
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Computer  Programs  Used  to  Develop  and  Evaluate  the  Test  Plans 
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UliBiiflMlVll 


mm 


1000 

C 

1010 

C«** 

1020 

c* 

1030 

c« 

THIS  PROGRAM  COMPUTES  THE  SEQUENTIAL  TEST  REGION 

10*0 

c« 

FOR  TESTING  THl  INDEPENDENCE  OF  A 2X2  CONTINGENCY 

1030 

c* 

TABLE  WHEN  THE  MARGINAL  PROBABILITIES  ARE  UNKNOWN, 

1060 

c« 

1070 

C*t* 

1080 

c 

1090 

DIMENSION  KTtlOll 

1100 

DIMENSION  KL ( 100) ,KU ( 100) 

1110 

COMMON  IL.IU 

1120 

DATA  INPUT, IOUT/50. 66/ 

1130 

I UP*0 

11*0 

READ (INPUT ,1212) I REG 

1130 

1212 

format  < i 2 > 

1160 

DO  2S  Id, 101 

1170 

25 

KT(I)«I-1 

liao 

READ( input, 62) ALPHA, BETA 

1190 

READ|INPUT,62)T2.T0 

1200 

AT0*AL0GlT0) 

1210 

AT2*ALOG<T2) 

1220 

WRITf ( IOUT, 233) TO, T2, ALPHA, BETA 

1230 

233 

FORMAT (-1T0=",F7, 3/-  T1s«,F7.3/"  ALPHA*" ,F7. 3/ -BETA* • ,F 

12*0 

READ( INPUT, 62)XM0 

1250 

MOxXNO 

1260 

62 

F0RMaT(8F10.0) 

1270 

AL 1SAL0G (BETA/ (1. -ALPHA) > 

1280 

BLlsALOGl (1. -BETA) /ALPHA) 

1290 

DO  22  N* 1 ,M0 

1300 

NP1*n*1 

1310 

WRITf ( IOUT ,888) 

1320 

888 

FORMAT ("0") 

1330 

WRITf ( IOUT ,*2)N 

13*0 

*2 

format ( • trial  ",i*,5x,-n.i") 

1350 

IF(N.NE.HO)  GO  TO  9 

1360 

ALl*<ALl«BLU/2. 

1370 

bli*ali 

1380 

1F(IrEG,LE,-1) IUP*-1 

1390 

IF (IREG.GF.I) IUP*1 

1*00 

IF  ( I jP.EO.  1)WRITE<  IOUT. 701 ) 

1*10 

701 

FORMAT ("  REGION  MOVE  UP") 

1*20 

IF  (IilP.EO.- DWRITEI  IOUT, 700) 

1*30 

700 

FORMAT ("  REGION  MOVE  DOWN") 

1**0 

9 

continue 

152 


1460  WRITE  (10UT, 6621 

1470  662  FORMAT (3X«aNl."l 

1460  WRITE  (IOUT .49) (XT ( I ) , I * 1 , NP1 ) 

1490  ' * F0RMaT(7X. 15(14, 3X)I 

1500  00  33  1*1. NP1 

1510  ! Ml  * 1 - 1 

1520  NlOOTsl-1 

1530  XN1D0T*J-1 

1540  DO  4«  Jtl.NPl 

1550  NOOT l*J-l 

1560  XNOOTl*J-l 

1570  IU«MINO(NDOTI,N1DOT).1 

1580  IL*MaXO(NDOT1.N1DOT-N.O)*1 

1590  FT0*FN0D (ND0T  l.NIDOT.N.ATO) 

1600  FT2«FNOD(NDOT1,N1DOT,N,AT2) 

1610  XL ( J) * I LNT ( (AL1«FTO-FT2)/(AT2-ATO) J 

1620  XU(J>*ILNT( (BL1*FTC-FT2)/(AT2-AT0> > *1 

1630  IF (X  J ( J) ,LT.-1)KL(J)«-1 

1640  44  continue 

1650  WRlTEdOUT.41)  INI 

1660  41  F0RMaT(-.-,I4) 

1670  WRITEI10UT.40) (XL (J) ,XU ( J) . J* l .NP 1 > 

1680  40  FORMAT!"  " ,4X .2X. 15 ( IX . 12 • " »•, 12 « 1 X) 1 

1690  33  continue 

1700  22  CONTINUE 

1710  STOP 

1720  END 

1730  C 
1740 
1750  C» 

1760  C*  THIS  PROGRAM  COMPUTES  THE  SEQUENTIAL  TEST  REGION 

1770  C#  FOR  TESTING  THE  EQUALITY  OF  TWO  BINOMIAL  PROPORTIONS 

1780  C.  „HfN  ONF  ITEM  IS  SELECTED  FPOM  EACH  POPULATION  AT 

1790  C*  EACH  TRIAL. 

1800  C* 

1810  

1820  C 

1630  DIMENSION  XT (101) 

1840  DIMENSION  XI  (100) ,XU(100) 

1850  COMMON  !L.Il‘«G(4)  « X ( 4 ) 

I860  Data  INPUT, IOUT/50«66/ 

1870  I UP*0 

1880  RE AO { INPUT , 1212) I REG 

1890  1212  F0RMaT(I2) 

1900  DO  25  1*1,101 

1910  25  XT ( I ) *1-1 

1920  READ(INPUT,62)ALPHA,BETA 

1930  RE AC (INPUT, 62)T0,T1 

1940  WRJTF  (I0UT,F4)T0,T1,ALPHA,BETA 

1950  64  FORMaT(»1TO=«,F8.2/"  T1*«,F8.2/"  AlPHA*«,F8.3/"  BETA*",F8.3///> 

I960  AT0*AL0G(T0) 


1970  AT  1 «AL0G  <T 1 > 

1990  READ ( INPUT, 62)Xf«0 

1990  MO«XmO 

2000  62  FORMAT (8F10.0) 

2010  NP1*2»M0*1 

2020  WR  J TE  < I OUT  *663) 

2030  663  FORMAT <50X«*N.l") 

2060  WRITE (IOUT, 69) <KT(I),i*l,NPl> 

2050  WRITE (IOUT. 662) 

206o  662  format < * trial*/*  ni.*i 

2070  Btl*ALOG( ( 1 .-BETA) /ALPHA! 

7090  Al 1 SALOG (BETA  / ( 1 #- ALPHA) 1 

2090  DO  22  Nr  0 

2100  Np  i x 2*N* 

2110  1FIN.NE.M01  GO  TO  9 

2120  AL 1 * ( *L 1 *BL 1 ) / 2 • 

2130  BL  1 * AL 1 

2160  IF(lREG.GE.l) 1UP*1 

2150  IF(lREG.LE.-l)IUP*-l 

2160  I F ( IuP.NE.O) WR ITE ( I OUT .700) 

2170  too  format c*  region  move*) 

2180  9 CONTINUE 

2190  69  F0RMaT(7X. 15(16, 3X)) 

2200  NlDoTsN 

2210  CO  6<,  Js  1 «NP 1 

2220  NOCTUJ-I 

22 30  IL«MaX0(NDOT1-N,0)*1 

2260  IU*Mino(NOOT1 ,NI  *1 

2250  FTO*FNOO(NDrTl ,N1DOT,2»N1DOT,ATO) 

2260  FT1*FNOC(NDCTI,N1DOT,2*N1DOT,AT1) 

22 70  tCL(J)*ILNT(  (AL1*FT0-FT1 ) / (ATl-ATO)  ) 

2280  #*IUP 

2290  KU(J)*1LNT( (PL  1 ♦FT0-FT1 ) / ( AT1-AT0) )*1 

2300  #*IUP 

2310  » F (Xj(j) ,lT . - 1 )KL (J>  5 — 1 

2320  6a  CONTINUE 

2330  WPjTf<  I0UT,6l)N 

2360  61  FORMAT (»♦», IA) 

2350  WRITE  (IOUT*60)  (XL(J) »KU(J) ,J*1 ,NPl) 

2360  60  FORMAT  ( " « , AX »2X« 15 ( IX , 12 ,* , 1 2 r 1 X) ) 

2370  22  CONTINUE 

2360  STOP 

2390  END 

2600  C 
2610  C« 

2620  C* 

2630  C» 

2660  C* 

2650  C* 

2660  C» 

2670  C* 

2680  C 


i 


THIS  PROGRAM  COMPUTES  THE  SEQUENTIAL  TEST  REGION 
FOR  TESTING  THE  INDEPENDENCE  OF  A 2X2  CONTINGENCY 
TABLE  WHFN  THE  MARGINAL  probabilities  ARE  KNOWN. 


I 

I 


j 


2*9  0 
2500 
2510 
2520 
2530 
25*0 
2550 
2560 
2570 
2560 
2590 
2600 
2610 
2620 
2630 
26*0 
2650 
2660 
2670 
2680 
2690 
2700 
2710 
2720 
2730 
27*0 
2750 
2760 
2770 
2780 
2790 
2800 
2810 
2820 
2830 
28*0 
285C 
2860 
2870 
2880 
2890 
2900 
2910 
2920 
2930 
29*0 
2950 
2960 
2970 
2980 
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DIMENSION  K T (101) 

DIMENSION  KL (100) iKU(IOO) 
data  input.iout/50*66/ 

1UP  = 0 

RE*D(  INPUT. 1212) IREG 
1212  F0RWAT(I2) 

DO  25  1*1.101 
25  K T ( I ) * I - 1 

REaD(INPUT«62) alpha .beta 

RE  AO  ( I NPUT  .62  ) P1D0T  «PDOT‘l  »P0 . PI 

READ(INPUT,62)XM0 

WRITf<10UT,67)P1DOT,PDOT1.PO,P1.ALPHA.BETA 
67  EOR*aT(»1P1.=".F7.3/"  P.l*".F7.3/«  PO*  ".F7.3/»  P1*".F7.3/ 

e " ALPHAs", F7.3/«  BETA*" »F7,3///) 

MOsXmO 

62  FORMaT(BFIO.O) 

XUI*AL0G(P1/P0) 

XU2*AL0G< (PCOT  1 — P 1 1 / (PDOT 1-Pl 1 ) 

XU3*AL0G< (P100T-P1) / (P100T-P0) ) 

XU**  ALOG ( ( 1 . -P 100T -PDOT 1 ♦ PO ) / < 1 • -P l D0T-PD0T l .PI ) ) 
ZUsXul-XU2-XU3.XU* 

XU*3sXU*-XU3 
XU*2sX J*-XU2 

BL1=AL0G( (1, -BETA) /ALPHA) 

AL1=AL06(BETA/(1, -ALPHA) ) 

DO  22  N* 1 , MO 
NPJ  *N« 1 

WR I Tf ( I OUT , 888 ) 

888  F0RMaT("0") 

WRJTE(10UT,*2)N 

*2  FORPATl"  TRIAL  %I*.5X»"N,1") 

IF (N.NE.MO)  GO  TO  9 
AL1*  (ALUBLD/2. 

BL1*AL1 

IF ( IREG.LE.-1 ) IUPs-1 
IF ( IREG.GE. 1 1 IUP*1 
IFddF.EC.  1 ) WRITE!  IOUT  , 701 ) 

701  FORMaTC-  REGION  MOVE  UP") 

IF< IuP.EO.-l )WR I TCI  I OUT, 700) 

700  FORMAT!"  REGION  MOVE  DOWN") 

9 CONTINUE 

XNsN 

WRjTf  ( IOUT .662) 

662  F0RMaT(3X,“I:1,") 

WRITE (I OUT, *9)  (KT  < I ) , I s 1 ,NPl ) 

*9  Format ( 7 x « 1 5 < I * * - ” 

DO  3 3 I * 1 ,NP 1 
I M 1 = I - 1 
XNlDoT=|-l 
DO  **  Jsl.MPl 


j 


2990 

3000 
3010 
3020 
3030 
30*0 
3050 
3060 
3070  64 
3090 
3090  61 
3100 
3110  60 
3120  33 
3130  22 
3160 
3150 
3160  C 
3170  C« 
3190  C* 
3190  C« 
3200  C« 
3210  C« 
3220  C* 
3230  C* 
3260  C« 
3250  C* 
3260  C« 
3270  C* 
3290  C* 
3290  C« 
3300  C# 
3310  C« 
3320  C«< 
3330  C 
3360 
3350 
3360 
370 

3380  C 

3390 

3600 

3610 

3620 

3630 

3660 

3650 

3660 

3670 

3680  C 

3690  C 


XND0T1*J-1 

XNUaXND0Tl*XU63«XNlD0T  *XU62-XN*XU6 
XL(J)*JLNT((AL1»XNU)/ZU> 

• ♦IUP 

XU ( J) s I LNT ( <RL 1 »XNU) /ZU) *1 
flUP 

IF (XL (J) .LT.-llKL(J)«-2 
IF(Xu(J>.LT.-1)XUU)»-1 
CONTINUE 

WR I Tf ( I OUT  *611 1M1 
F0RN*T(»*»,141 

write  (I OUT. 60)  (KUJ)  *KU ( J ) ,J«l,NPl) 

FORMAT  (•  ",4X,2X,15(lX,12«',,".I2,lxn 

CONTINUE 

CONTINUE 

STOP 

end 


this  program  figures  and  evaluates  regions  for  a sequential 
TEST  OF  A 2X2  CONTINGENCY  TABLE.  THE  TEST  IS  BASED  ON  THE  CROSS 
PRODUCT  RATIT.  TRUNCATION  OF  REGIONS  IS  ALLOWED. 

SAMPLES  ARE  TO  BE  TAKEN  IN  PAIRS  FROM  TWO  DIFFERENT  POPULATION. 
THIS  PROGRAM  IS  FOR  A THREE  OECISION  TEST, 


WILLIAM  0.  MEEKER.  JR. 

INSTITUTE  OF  ADMINISTRATION  AND  MANAGEMENT 
UNION  COLLEGE 

SCHENECTADY,  NEW  YORK  12309 
AUGUST  1976 


DIMENSION  A(27,27) ,B(27,27( 

DIMENSION  ACC0I75J ,ACCl  (75) ,ACC2(75) 

DIMENSION  ACCOT ( 75) , ACC  IT (75) ,ACC2T (75) ,N9 (75) »PCH(75> 
DIMENSION  PAR (75 1 ,P3(75) ,PA(75) «PN{75) 

DIMENSION  X (6 ) 

integer  twon 

REAL  N9.NT9 

LOGICAL  UPt  «UP2  .DOWN l .DOWN 2 
COMMON  IL,IU,G(6l,  X1,X2.X3,X6 

equivalence  cxi.xm  > 

EQUIVALENCE ( 1 1 »K ) 

DATA  I PNOUT/58/ 

DATA  INr,UT  , I OUT/50 ,66/ 

specify  mkloweri,  ho<middle»,  h2(upperi 
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3500  C 
3510  C 
3520 

3530  1212 

35*0 

3550 

3560 

3570 

3580  TO 

3590 

3600 

3610 

3620 

3630  C 

36*0  C 

3650 

3660 

3670 

3680 

3690 

3700  57 

3710 

3720  51 

3730 

3750 

3750  55 

3760 

3770  9*5 
3780  C 
3790  t 
3800  C 
3810 
3820  1 
3830 
3850 
3850 
3860 
3870 
3880 
3890 
3900 
3910 
3920 

3930  9922 
3950 
3950 
3960 
3970 
3980  C 
3990  C 
5000  C 


TAKE  LOGS  FOR  LATER  USE 

Read (INPUT *1212 1 IPUN.IREG 
F0RM*T(2I1) 

IUP«0 

READ(1NPUT.70)ALPHA1,B£TA1,ALPhA2,BETA2,XM0.T2,T0,TI 

IF(T0.E0.0.0)T0*1,0 

IF(Tl.E0.0.0)Tl*l«/T2 

F0RM*T(8F10.0) 

MOsXmO 

AT1*AL0G(T11 

ATo*.'LOG(TO) 

AT2*A«.OG(T2j 


SET  DESIRED  ERROR  PROBABILITIES.  CRITICAL  LIMITS  AND  THEIR  LOG 
A1sAlPHA1/(1.-BETA1) 

Bl* < 1.-ALPHA1) /BETA1 
A2=BFTA2/(1.-ALPHA2> 

B2s(i.-BETA2)/ALPHA2 

WRITe(I0UT,57) 

FORMAT (1H1  ,9X.lHT.7X.7HAL0G<T>/> 
write  (IOUT.5DT1.AT1.TO.ATO.T2.AT2 

FORM,  a T ( 3H  T1.2X,2(3X.F7.5)/3H  T0.2X.2  OX.F-*.*) /3H  T2 .2X.2  (3X.F7.5) 
6) 

WRlTr ( I OUT, 55) ALPHA  1 .BETA1 

FORMAT (///lOh  ALPHA1  * ,F5.3/9H  BETA1  * .F5.3  ) 

write ( i out ,9551  alpha 2 .beta? 

FORMAT!/  10H  ALPHA2  * .F5.3/9H  BETA2  * ,F5.3  ) 

READ  SELECTED  ALTERNATE  HYPOTHESES  WHERE  THE  REGION  IS  TO  BE  E 


!«0 

continue 


i = i*i 

REtC (INPUT, 70 
IF  (P)  .EG. 0.0) 
02sl.-P2 
01=1. -PI 
PAR(I)sALOG( 

pa ( I i = alog ( p 1 

PB(I»=ALOG( 

PN(Ii=AL0G( 


GO 

TO  1 

nalT.i-i 

*L1 

= ALOG 

(Al) 

bli 

= ALOG 

(Bl) 

*L2 

= ALOG 

(A2) 

BL2 

= ALOG 

(B2) 

IMT 

ILI2E 

1P1.P2 
GO  TO  9922 


P2) 

) 

on 

02) 


I 

I 

] 


* 


4010 

4020 

4030 

4040 

4090 

4060 

4070 

4060 

4090 

4100  4486 

4110  C 

4120  C 

4130  C 

4140 

4150 

4160  66 

4170 

4180 

4190 

4200 

4210 

4220  77 

4230 

4240 

4250 

4260 

4270  *499 
4260 
4290  C 
4300  C 
4310  C 
4320 

4330  *477 

43*0 

4350 

4360 

4370 

4380 

4390 

4400  700 

44 1 0 56 

4420 

4430 

44*0  C 

4450  C 

4460  C 

4470 

4460 

4490 

4500  C 

4510  C 


A ( 1 » 1 ) *.25 
A<1. 21*. 25 
A ( 2 • 1 1 *.25 
A(2*21 *.25 
00  *468  I«1.NALT 
ACC1T(11*0.0 
ACC2MIH0.0 
ACCOM  11*0.0 
N9( 1 ) «0.0 
CONTINUE 

INCREMENT  TRIAL  NUMBER 
DO  34  Ns  1 »M0 

WRITE! I OUT «66)  N 
format (-  trial  number  -.15> 

TW0N*2»N 

NlsTwCN.l 

13*N*2 

DO  77  I «1  • 1 3 
00  77  J*1  • I 3 
B<I.j)*0. 

DO  *499  1*1 «NALT 
ACCO  <11*0.0 
ACC1  (11*0.0 
ACC2  <I)«O.C 
continue 

IF (N.NE.MOl  BO  TO  56 

ALLOW  TRUNCATION  IF  DESIRED 
DO  *477  1*1 ,NALT 

PCM< 1 1 * 1 .-ACCOT  < 1 1 -ACC1 T ( I ) -ACC2T ( 1 1 
AlI*  (ALMBL11/2. 
bli*ali 

AL?s(AL2*BL21/2. 

BL2*AL2 

IFdaEO.EO.il  IUP*l 

IF d UP. EO. 1 1 WRITE! IOUT. 700) 

FORMAT  («  REMON  MOVE") 

CONTINUE 

OsFLOAT (Nl* <0.693 14  71 8 1 
0*-2  »Q 


ENUMERATE  ALL  POSSIBLE  BOTTOM  MARGINS 

DO  22  Jsl.Nl 

NDOTl=J-l 

NOOT?sTWON-NOOT1 


; 


I 


FIGURE  LOWER  AND  UPPER  LIMITS 
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4520  C 

4530 

4540 

4550  C 

4560  C 

4570  C 

4560 

4590 

4600 

4610  C 

4620  C 

4630  C 

4640 

4650 

4660 

4670 

4660 

4690 

4700 

4710 

4720  C 

4730  C 

4740  C 

4750 

4760 

4770 

4760 

479C 

4800 

4810 

4820 

4830 

4840 

4850  15 

4860 

4870 

4860 

4890 

4900  C 

4910  C 

4920  C 

4930 

4940 

4930 

4960  C 

4970  C 

4980  C 

4990 

5000 

5010 

5020 


IUrM|N0(ND0Tl.N)*l 

1LsNAX0(ND0T1-N,0)*1 

SKIP  IF  REGIONS  ARE  ALREADY  SAVED 

FT0*FN0C(NDCT1 .N.TWON.ATO) 

FT1*FN0D(ND0T1 .N.TwON.ATl) 

FT2=FN0C(ND0T1 .N.TW0N.AT2) 

FIGUPE  CRITICAL  VALUES  OF  REGIONS 

KL1*ILNT< (AL  1 ♦FT 1-FTO) ✓ (ATO-ATill 
•-luP 

KU1*ILNT( (BL1*FT1-FT0)/(AT0-AT1))*1 
•-luP 

KL2* I LNT ( ( AL2*FT0-FT2 ) / ( AT2-AT0) ) 
•*IUP 

KU2*ILNT( (B12*FT0-FT2)/ (AT2-AT0))*1 
•*IUP 


ENUMERATF  POSSIBILITIES  FOR  CURRENT  REGIONS 

DO  11  KrlL.lU 
XlsK-1 
K2»X  1 
X2*N_X1 
X3;NqOT 1-X 1 
X4*N-X3 
1 1 sX 1 ♦ l 
JJsX3*l 
PRQPsA  ( 1 1 * JJ) 

IF (PROPI 15.20. 15 
UP  1 =<  2.GE.KU 1 
PR00s=PR0B».25 
D0*Nl=K2.LE.KLl 
UP2  s < 2 .GE  .Kl.2 
DC«';''2  = K2.L£.KL2 

DETERMINE  PROPER  ACTION. 

IF (OqwNI ,ANC.D0*N2)  GO  TO  200 
IF(UPl.AND.l’P2)  GO  TO  400 
lF,-'.,Pl.AND.P0i»N2)  GO  TO  300 

IF  THIS  IS  A CONTINUATION  POINT,  SEND  PROBABILITIES  TO  NEXT  ST 

8 < 1 1 ♦ 1 ,JJ) =P ( 1 1 ♦ 1 , JJ) *PR0B5 
B ( 1 1 . JJ* 1 1 sP ( 1 1 . JJ. 1 ) *PR0B5 
Bill , JJ) r B ( 1 1 , JJ) *PR0B5 
0(1 1*1 . JJ* 1 ) :B ( 1 1*1 , JJ* 1 ) *PR0B5 


5030  GO  To  20 

50*0  C 

5050  C ACCUMULATE  PROBABILITIES  FOR  A TERMINATION  POINT. 

5060  C 

5070  200  00  1099  JV«1.NALT 

5080  ACC1 (IV)sACCl <IV)*PROB 

5090  8*C0£F  (PA  ( I V)  .PB(I V)  .PABtIV)  .PN(IV)  .0) 

5100  1099  CONTINUE 

5110  GO  To  20 

5120  300  DO  1199  IV=1 .NALT 

5130  ACCO<IV)sACCO(IV)*PROB 

51*0  8*C0EF ( PA ( 1 V ) .PB (IV) .PAB(IV) .PN(IV)  .0) 

5150  1199  CONTINUE 

5160  GO  To  20 

5170  *00  DO  1299  IVsl.NALT 

5180  ACC2dV)cACC2(lV)«PROB 

5190  8»C0Er (PA ( 1 V) ,PB(1V) ,PAB(IV) .PN(IV) ,0) 

5200  1299  CONTINUE 

5210  20  CONTINUE 

5220  11  CONTINUE 

5230  22  CONTINUE 

52*0  C 

5250  C ACCUMULATE  PROBABILITIES  AND  EXPECTED  VALUES. 

5260  C 

5270  DO  2590  IV*1.NALT 

5280  T9«AfC0UVl*ACCUlVI*ACC2(IV» 

5290  ACClT(IV) «ACC1T( I VI ♦ ACC  1 C I VI 

5 300  ACCOT ( IV) sACCOTI IV) .ACCO J IV) 

5310  ACC2T(lV)sACC2T(IV).ACC2(lV» 

5320  NT  9*N*T9 

5330  N9(Iv)aN9(lV»*NT9 

53*0  2590  continue 

5350  IF(N.EO.MO)  GO  TO  **5 

5360  C 

5370  C MOvr  PROBABILITIES  BACK  FDR  THE  NEXT  STEP. 

5380  C 

5390  DO  **  1:1.13 

5*00  DO  **  J: 1.13 

5*10  **  An.jlsB(I.J) 

5*20  **5  CONTINUE 

5*30  3*  CONTINUE 

5**0  DO  6258  Isl.NALT 

5*50  PltExPIPAIIl) 

5*60  P2*ExP(PAB(I>) 

5*70  TsPU  (1.-P2)  / (P2M1.-PIM 

5*80  IF ( IPUN.EO. 1 » WRITE ( IPNOUT .126) PI  *P 2 *T« ACC1T ( I ) .ACCOT (I) .ACC2T ( I > «N 

5*90  «9(I),PCH(1> 

5500  WRITE ( I OUT .1261P1.P2.T  » ACC1 T ( 1 ) .ACCOT (1 1 » ACC2T ( I ) «N 

5510  #9(l),PCH(IJ 

5520  126  FORMaT(1X.2F6.2.F10,5.3F10.5.F10.2.F10.5) 

5530  6258  CONTINUE 


'1 
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55*0 

5550 

5560 

5570 

5580 

5590 

5600 

5610 

5620 

5630 

5640 

5650 

5660 

5670 

5680 

5690 

5700 

5710 

5720 

5730 

5740 

5750 

5760 

5770 

5780 

5790 

5800 

5810 

5820 

5830 

5840 

5850 

5860 

5870 

5880 

5890 

5900 

5910 

5920 

5930 

5940 

5950 

5960 

5970 

5980 

5990 

6000 

6010 

6020 

6030 

6040 


STOP 

END 

I 

C» 

O THIS  PROGRAM  FIGURES  AND  EVALUATES  REGIONS  FOR  A SEQUENTIAL  TEST 
C»  OF  A 2X2  CONTINGENCY  TABLE.  THE  TEST  IS  BASED  ON  THE  CROSS 

C«  PRODUCT  RATIO.  TRUNCATION  OF  REGIONS  IS  ALLOWED.  THE  MARGINAL 

C*  PROBABILITIES  ARE  ASSUMED  TO  BE  UNKNOWN.  THIS  PROGRAM  IS  FOR  A 

C#  THREE  DECISION  TEST. 

C* 

c#  WILLIAM  Q.  MEEKER.  JR. 

C«  INSTITUTE  OF  ADMINISTRATION  AND  MANAGEMENT 

C*  UNION  COLLEGE 

C«  SCHENECTADY.  NEW  YORK  12308 

O AUGUST  1974 

C* 

c* 



C 

DIMENSION  AI27.27J .8(27,27,2) 

DIMENSION  PI (100) ,P2(100) .P3(100) ,P4(100) 

DIMENSION  ACC1 (100) , ACC2 ( 1 00 ) , AC CO ( 1 00) 

DIMENSION  ACCIT(IOO)  .ACC2T  (100)  .ACCOT ( 100) ,PCH ( 100) ,N9  1 100) 

REAL  N9.NT9 

LOGICAL  UP  1 , UP 2 » DOWN  1 .DOW N2 

COMMON  IL.IU.G1 <G2.G3,G4.X1,X2.X3<X4 

DATA  TO/1./ 

DATA  ATO, II, 12/0. ,1,2/ 

DATA  ITOUT.IT IN. I POUT » INPUT  « 1 0UT/90 .91 .58,50*66/ 

C 

c SPECIFY  HI (LOWER)  ANO  H2(UPPER).  Ho  IS  ASSUMED  TO  BE  T*l. 

C TAKE  LOGS  FOR  LATER  USE 

C 

READ (INPUT, 12 12) IPUN.IREC 
1212  FOPMaT (211) 

IUP  = 0 

READ(INPUT,70)ALPHA1,BETA1,ALPHA;:,5ETA2,XM0.T2,T0.T1 

TUI./T2 

to*  i . 

MOsXMO 
AT1=AL0G(T1 ) 

AT2*AL0G(T2) 

c 

c SET  DESIRED  ERROR  PROBABILITIES.  CRITICAL  LIMITS  AND  THEIR  LOG 

C 

A lsA(_ PHA 1 / ( 1 .O-OETA l ) 

*2sPFTA2/(  1.0-ALPHA2) 

Bis ( 1 ,0-ALPHAl ) /BETA l 
B2s ( 1 .0-BETA2 ) /ALPHA 2 
WRITE ( I OUT ,47) 

47  FORMAT (1HI , 6X .6HNUMBER ,5X , 3HLDG/) 


liMSMiatMi 


6090 

6060 

6070 

6000 

6090 

6100 

6110 

6120 

6130 

6160 

6130 

6160 

6170 

6100 

6190 

6200 

6210 

6220 

6230 

6260 

6230 

6260 

6270 

6260 

6290 

6300 

6310 

6320 

6330 

6360 

6350 

6360 

6370 

6300 

6390 

6600 

6610 

6*20 

6630 

6660 

6650 

6660 

6h70 

6600 

6690 

6500 

6510 

6520 

6530 

6560 

6550 


WRJTF (I0UT.61) T0.AT0. Tl, ATI .T2.AT2 

61  FORMaTOH  T0,2X.2(3X»F7«6)/3H  T1,2x*2 (SX.F7.6) /3H  T2.2X.2 (3X*F7.6) 
6) 

WR1 Tp  ( I OUT  »65l ALPHA  1 .0ETA1 , ALPHA 2, BET A2 
65  F0RMaT(///10H  ALPHA  1 s .F5.3/9H  BETAl  « ,F5.3 

t/lOH  ALPHA2  * .F5.3/9H  BET A2  * »F5.3  ///) 

C 

c READ  SELECTED  ALTERNATE  HYPOTHESES  WHERE  REGIONS  ARE  TO  BE  EVA 

C 

1 *0 

i continue 

l«i*t 

READ ( INPUT  » 70) PI  1 1 ) .P2 ( 1 ) «P3 ( I ) *P6 ( 1 1 
IF (Pi ( I ) . EO.O.O)  GO  TO  9995 
P6(i)>i.-Pim.P2m-P3(n 
go  to  i 

9995  NALT.I-1 

DO  2265  Isl.NALT 

pi  iImalogipi  mi 
P2(I>:ALOGtP2<m 
P3(h*ALOG(P3(ll» 

P6 ( I | * ALOG  <P6 (1)1 

2205  continue 

AL1sAL0G(A11 
AL2* ALOG ( A2 1 
BL1*AL0G(B1I 
BL2*aL0G(B2) 

70  FORMAT ( 8F 1 0,0) 

CALL  SETSCT ( I TOUT , 1 1 
call  SETSCT ( I T IN 1 1 ) 
c 

c WRITE  PROBABILITIES  FOR  THE  FIRST  STEP 

C 

B(l.l, l)s. 25 
B(l,  ?»!)«. 25 
B(1.1.2)s.?5 
B(2.?.2)s,25 

WRITfIITIN  ) ( (B(XX.JX.l)  ,KK=l,2) ,JK*1.2) 

WR  I TF ( I T I N ) ( (BIKK.JK.2)  ,XK8l  ,2) ,JKil,2) 

call  setscT(ITout.I) 

CAlL  SETSCT ( I T IN , 1 ) 

00  900  Isl.NALT 
N9( I ) sO.O 
ACClT ( 1 1 *0,0 
ACCOT(1)sO.O 
ACC2T(I)80,0 
900  CONTINUE 
C 

c «<<  INCREMENT  TRIAL  NUMBER  »> 

C 

DO  36  Ns l , MO 


- - • 


6560 

*RlTf  <1 OUT *56 37 IN 

6570  5637 

F0RHaT<»  MOW  AT  TRIAL  ■ « 15) 

6560 

Q«FL0AT<NI«(-1. 38629*) 

6590 

NliN.l 

6600 

I 3aN«2 

6610 

00  5 22  I«1*NALT 

6620 

ACC) ( 1 ) *0.0 

6630 

ACC2 ( I ) *0.0 

66*0 

ACCO ( 1 ) >0.0 

6650  52 2 

CONTINUE 

6660 

IF(N.NE.MO)  CO  TO  56 

6670 

IF(IREC.NE.0)PR1NT  1777 

6680 

IF ( IREC.NE.O) IUP»1 

6690  1777 

format (■  region  move*) 

6700  C 

6710  C 

/.'.LOW  TPUNCATION  IF  OESIRED 

6720  C 

6730 

ALI*(ALl*BLl)/2.0 

67*0 

AL2*(AL2«8L2)/2.0 

6750 

bli*ali 

6760 

BL2*AL2 

6770 

DO  2777  I.l.NALT 

6780  2777 

PCM  ( I) r I ,-ACC 1T(I) -ACC2T ( I ) -ACCOT { I ) 

6790  56 

continue 

6800 

DO  7«  1*1 ,13 

6810 

DO  7a  J*1,I3 

6820  78 

B ( I t.J»  1 1 ) *0.0 

6830  C 

68*0  C 

<«  ENUMERATE  ALL  P05SIBLE  MARGINS 

6650  C 

6860 

DO  33  I«1,N1 

6870 

DO  77  Kb  1 , 1 3 

6880 

DO  77  J: 1 , I 3 

6890  77 

B (<  » J« 12 1 sO.O 

6900 

PEaD(ITIN) ( (A(KK,JK) ,KKe1 ,N1) »JK*l,Nl) 

6910 

N100t=I-1 

6920 

DO  22  J«1,N1 

6930 

NOOTliJ-l 

69*0  C 

6950  C 
6960  C 

FIGURE  LOWER  ANO  UPPER  LIMITS  DN  Nil 

6970 

IU*)‘ INO(NDOT1 . N100T)  «1 

6980 

IL=PaX0(MDOT1.N1DOT-N,O) ♦! 

6990 

FT  l =FNOD ( NOCT 1 «N1 DOT , N , AT  1 ) 

7000 

FT2*FN0D (MOOT  1 *N1D0T . N«AT2) 

7010  C 

7020  C 
7030  C 

FIGURE  CRITICAL  VALUES  OF  REGIONS 

70*0 

KLI  = ILNT(-(ALUFT1)/AT1)-IUP 

7050 

»CU1  = ILNT(-0!L1*FT1)/AT1)-IUP*1 

7060 

<U2*ILNT ( (BL2-FT2) /AT  2) *1UP*1 

>>> 


— 
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7070 

7080  C 

7090  C 

7100  C 

7110 

7120 

7130 

71*0 

7150 

7160 

7170 

7180 

7190  15 

7200 

7210 

7220  C 

7230  C 

72*0  C 

7250 

7260 

7270 

7280 

7290 

7300  C 

7310  C 

7320  C 

7330 

73*0 

7350 

7360 

7370 

7380  C 

7390  C 

7*00  C 

7*10  200 

7.20 

7*30  H001 
7**0 

7*50  300 
7*60 

7*70  8002 
7*80 

7*90  *00 
7500 

7510  8003 
7520  20 
7530  1 1 
75*0  22 
7550 
7560 
7570 


KL2*1LNT( (AL2-FT2)/AT2)*IUP 

<«  ENUMERATE  POSSIBILITIES  FDR  CURRENT  REGIONS  »> 

DO  ll  Ks IL • !U 
K2.K.1 
Xl»K2 

X2.N100T-K2 
X3.N00T1-K2 
XAsN.Nl DOT -NDOT 1 *K2 
PROesA(K.J) 

IF(PROB) 15,20*15 
UPlsx2.GE.KUl 
PROfi75spRO0*.25 
D0wN2sK2.LE.KL2 

DETERMINE  PROPER  ACTION. 

IF(  (UP1.AND.00WN2) 1 GO  TO  *00 
D0wNlsK2.LE.KLl 
1F(D0WN1.AND.OOwN2)  GO  TO  200 
UP2*k2.GE.KU2 
I F (Up  1 . AN0.UP2 1 GO  TO  300 

IF  THIS  IS  A CONTINUATION  POINT,  SEND  PROBABILITIES  TO  NEXT  STE 

B(K«JiI2)s()(K«J<I2)  .PR0B25 
B(Ki.).I1)sR(k,J,I1>  .PROB25 
B(K.J«1.I 1) =B(K.J«I , I1)*PR0B25 
B ( < ♦ 1 , J. 1 , 12 )sB(K*l.J* 1,12) .PR0B25 
GO  To  20 

ACCUMULATE  PROBABILITIES  FOR  A TERMINATION  POINT. 

DO  8001  I Vs  1 ,NAL  T 

ACC l (IV)sACCl  ( IV) ♦PROB*COEF(Pl  ( I V) , P2 ( I V) «P3 1 1 V) «P*  1 1 VI  *0) 

CONTINUE 
GO  To  20 

00  8002  IVsl.NALT 

ACC2 ( IV) sACC2  ( IV) *PROB*COEF (PI ( IV) »P2 ( IV) »P3(  IV)  ,P*(IV1.0) 

CONTINUE 
GO  To  20 

DO  8003  iVsl.NALT 

ACCO(lV)sACCO(IV)»PROB»COEF(Pl  (IV)  ,P2 ( I V) » P 3 ( I V ) «P* ( IV) ,0) 

continue 

continue 

contjnuf 

continue 

WR  1 Tf ( 1 TOUT  ) ((B(KJ,JK,I1) ,<J=l,I3J,JKsl.I3> 
iHOLQsI 1 

1 1 s I 2 
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i 


75®0 

7590 

7600 

7610 

7620 

7630 

76*0 

7650 

7660 

7670 

7680 

7690 

7700 

7710 

7720 

7730 

77*0 

7750 

7760 

7770 


i 


7780 

7790 

7800 

7810 

7820 

7830 

78*0 

7850 

7860 

7670 

7880 

7890 

7900 

7910 

7920 

7930 

79*0 

7950 

7960 

7970 

7980 


1 2*1  HOLD 
33  CONTINUE 

WRITE  (I  TOUT  )<<B<KK,JK.11» <<K*l,!3!,JK*l,I3l 

Call  setsctutout.d 

call  SETSCT(ITIN.l) 

IH0L0F*ITIN 
1 T I N* I TOUT 
iTOUTslHOLDF 
C 

c ACCUMULATE  PROBABILITIES  and  EXPECTED  VALUES. 

C 

DO  8005  1V«1,NALT 

T9*AcC0<  I V1<ACC1<IVHACC2<  I VI 

ACC2T<  IV)  *ACC2T<IVXACC2<IV» 

ACClTI  IV) SACC1T<IVI<ACC1<  I VI 
ACCOTUVIsACCOT  <IVJ<ACCO<  I VI 
NT9*FL0AT(NI»T9 
N9<IVUN9<IV1<NT9 

8005  continue 
3*  CONTINUE 

DO  6565  Hl.NALT 
pi  <i)*ExP(Pi<m 
P2<IHEXP<P2<D1 
P3<IHEXP<P3<I11 
6565  PA  <IHEXP<PA<111 
DO  3*59  Hl.NALT 

WRITE (ICUT.A562I  PI  (I)  ,P2<I1.P3<I> ,P*(Il  .ACClTI  II 
6 . ACC0T<D<ACC2T<II  .N9(I) 

• <PCH<D 
I F ( I PUN.EO. 1 ) 

6 WHITE  <lPOt;T. *5621  PI  <11  <P2<D<P3<D  <PA<D<ACC1T<I1 
0 <ACC0T<D<ACC2T<D<N9<I1 

f <PCH<D 

*562  FOR^AT<1X,*F6.3<3F10.5<F12.3<F10.51 

3*59  continue 

99  PRINT  *56 

*56  FORMaT<"OENO  OF  RUN"! 

STOP 

END 

C 

c 


7990 

C* 

8000 

c* 

THIS  PROGRAM  FIGURES  AND  EVALJATEST  REGIONS  FOR  A SEQUENTIAL  TEST 

8010 

c* 

OF  A 2X2  CONTINGENCY  TABLE  WITH  KNOWN  MARGINAL  PROBABILITIES. 

8020 

c* 

THIS  PROGRAM  IS  FOR  A THREE  DECISION  TEST  PROCEDURE. 

8030 

c* 

TRUNCATION  OF  THE  TEST  IS  ALLOWED. 

80*0 

c* 

* 

8050 

c. 

WILLIAM  0.  MEEKER < JR. 

8060 

c* 

INSTITUTE  OF  ADMINISTRATION  AND  MANAGEMENT 

- 

8070 

c« 

UNION  COLLEGE 

8080 

c* 

SCHENECTADY,  NEW  YORK  12308 

- 

f. 


I. 


[ 


AUGUST  197* 


8090  C* 
8100  C* 
8110  C* 
8120  C*t« 
8130  C 
81*0 
8150 
8160 
8170 
8180 
8190 
8200 
8210 
8220 
8230 
82*0 
8250  C 
8260  C 
8270  C 
8280  C 
8290 

8300  1212 

8310 

8320 

8330  106 
83*0 
6350 
8360 
8370 
8380 
8390 
8*00 
8*10 
8*20 
6*30 
8**0 
8*50 
8*60 
8*70 
8*80 
8*90 
8500 
8510 
8520 
8530 
85*0 
8550 
8560 
8570 
8580 
8590 


DIMENSION  A(27, 27) ,8(27,27,2) 

DIMENSION  PI (20)  ,P2 (20) ,P3 (20) ,P*  (20) 

DIMENSION  ACCl (20) ,ACC2(20)  ,ACC0(20) 

DIMENSION  ACCl T (20) ,ACC2T(20) , ACCOT  (20) ,N9 (20) 

DIMENSION  PCH(20) 

EQUIvALENCE(AT1,XM0) 

REAL  N9.NT9 

LOGICAL  UP1.UP2.DOWN1.DOWN2 
COMMON  I L « III  <G1  ,G2  ,G3  ,G*  , X 1 ,X2,X3,X* 

DATA  I TOUT , ITIN,  I POUT .INPUT  , IDuT /90, 91, 58, 50, 66/ 

DATA  ATO, II, 12/0, ,1,2/ 

SPECIFY  HI (LOWER)  AND  H2  (UPPER).  HO  IS  ASSUMED  TO  BE  T*l. 
TAKE  LOGS  FOR  LATER  USE 

READ ( INPUT, 1 212)  IPUN.IREC 
F0RM»T(2I1) 

IUP=0 

RE aD( INPUT ,70) ALPHA  1 .BETA l ,ALPHA2,BETA2,XM0 
READ(INFUT.70)P1D0T,PD0T1 . OH  1, PHI, SHI 
IF(ShI.EO.O.O) SH1sP1D0T»P00T1 
MOsXmO 

PH2sP  1D0T-PH1 

PH3SPOOT1-PH1 

Pha=1  ,-POOT1-P1UOT*PH1 

0H2 1 P 1 DOT-OH 1 

Oh<.=  i.-P1COT-PDOT1*OH1 

OH3=PDOT1-OH1 

SH?sp1D0T-SH1 

SM3SPD0T  l-Sl'l 

Sh<(  = 1 ,-PlDOT-PDOTl  *SHl 

XU1*ALCG(PH1/SH1) 

XU2=ALOG(PH2/SH2) 

XU3=AL0G(PH3/SH3) 

XUa  s ALOG (PHA/SH* ) 

ZUsXul  - XU2-XU3*XU* 

XL  1 s ALOG (SHI /0H1 ) 

XL2=ALOG(SH2/OH2) 

XL3=ALOG(SH3/OH3) 

XL*=A10G(SHA/0H*) 

ZL  = Xl  1-XL2-XL3«XL* 

XL*3=XL*-XL3 
XL*2=XL*-XL2 
XU*3=XU*-XU3 
XU«.2  = XU*-XU2 

WRITf ( I0UT.A71QH1  ,OH2,OH3,3HA,SH1 .SH2.SH3 ,SH* ,PH1 ,PH2,PH3  , PH* 


8600  67 
8610 
8620  C 
86)0  C 
8660  C 
8650 
8660 
8670 
8680 
8690 
8700  65 
8710 
8720 
8730  C 
8760  C 
8750  C 
8760  1 
8770 
8780 
8790 
8800 
8810 
8820 
8830 

8860  9995 

8850 

8860 

8870 

8880 

8890 

8900  2265 

8910 

8920 

8930 

8960 

8950  70 

8960 

8970 

8980  C 

8990  C 

9000  C 

9010 

9020 

9030 

9060 

9050 

9060 

9070 

9080 

9090 

9100 


FORMaTCO  Pll  P12  P21  P22V 

i-  Hi  -.6FB.3/-  HO  *,6F8.3/*  H2  ".6F8.3) 

SET  DESIRED  ERROR  PROBABILITIES*  CRITICAL  LIMITS  AND  THEIR  LOG 

AlxAi  PHAl/U.O-BETAU 
A2«EfTA2/(1.0-ALPHA2I 
Bis ( 1 . 0- ALPHA  1 ) /BE  T A 1 
B2*  < 1 .0-8ETA2) /ALPHA2 

WR I Tp { IOUT  .651 ALPHA1 ,6ETA1 , ALPHA2 ,BETA2 
F0RMaT(///10H  ALPHA  1 * .F5.3/9H  BETA1  « .F5.3 
6/10H  ALPHA2  « .F5.3/9H  BET A2  s .F5.3  ///) 

1*0 


read  SELECTED  ALTERNATE  HYPOTHESES  WHERE  REGIONS  ARE  TO  BE  EVA 

CONTINUE 

1*1*1 

REaD(  JNPUT.70IP1 (I) 

I F (P 1 (I). EC. 0.0)  GO  TO  9995 
P2(l!=PlD0T-Pl«I) 

P3  ( I ) sPDOT  1-PI ( I ) 

P6(I|*1.0-PD0T1-P1D0T*P1(I» 

GO  To  1 
NALTsI-1 

DO  2265  Isl.NALT 
Pi ( I ) *AL0G(P1 ( I ( ) 

P2(Il*AL06IP2(in 
P 3 ( 1 ) sALOG (P3 (III 
P 6 ( 1 j *AL  OG (P6 ( I ) ) 

conTjnu; 

ALI*AL0G(A1I 

*L2sALCG(A2) 

3L1=AL0G(B1) 

BL2*AL0Ci  (D2 1 
FORMaT(OFIO.O) 

call  setsctiitout.i) 

Call  SETSCTlITIN.il 

*R I TE  PROBABILITIES  FOR  THE  FIRST  STEP 

3(2.2. 2)=. 25 
B(l.l,2)=.25 
B(1.2.1)*.25 
B ( 1 .1  ,1)8.25 

WRITE (IT IN  M (B(KK.JK.l) ,KK*1.2) .JKsl.2) 

WRITfi I TIN  ) ( (B(KK,JK,2) ,KK=1,2) ,JtC*l,2) 

call  setsct(Itout.d 
Call  SETSCT ( I T IN. 1 ) 

DO  900  Isl.r.ALT 
N9(I)S0.0 


I 

i 

1 


9110 

9120 

9130 

91*0  900 
9150  C 


9160  C 
9170  C 
9180 
9190 

9200  5637 

9210 

9220 

9230 

92*0 

9250 

9260 

9270 

9280 

9290  522 
9300 


C 

c 

c 


9310 
9320 
9330 
93*0 
9350  2777 
936', 

9370 

9380 

9390 

9*00 

9*10 

9*20  1777 
9*30  56 
9**0 
9*50 
9*60 
9*70  <- 
9*80  C 
9*90  C 
9500 
9510 
9520 
9530  77 
95*0 
9550 
9560 
9570 
9580 
9590 
9600 
96’ 0 


ACC1 T (11*0*0 

accotu  >«o.o 

ACC2T«I»*0.0 

CONTINUE 

<<<  INCREMENT  TRIAL  NUMBER  >» 

00  3*  N« 1 «M0 
WRITf  (I0UT,5is37)N 

format r non  at  trial  * • I 5» 

OcFLOAT(N) • (-1.38629*) 

XN*N 

NlsN.l 

I3*N*2 

DO  522  | s 1 »(:ALT 
ACCl (1 ) *0.0 
ACC2 ( I ) *0.0 
ACCO(I)«0.0 

continue 

IF(N.NE.MO)  GO  TO  56 

ALLOW  TRUNCATION  IF  DESIRED 
DP  ‘ ’ ’7  1 = 1 .nALT 

F 1 1 ) = 1 . -ACC  1 T ( I , -ACC2T ( I ) -ACCOT ( I ) 

AL1*(AlUBL1»/2.0 

AL2*(AL2*PL.',i/2.0 

BL 1*AL  1 

BL2*AL2 

IF  (lREC.NE.Ol  PRINT  ,777 
IFdPtC.NE.C1  IUP*1 
FORMAT («  REGION  MOVE") 

CONTINUE 
DO  78  1*1,13 
DO  7b  J*1 , 1 3 
0 ( I ♦ .1*  1 1 ) =0.0 

«<«  ENUMERATE  ALL  P05SIBLE  MARGINS  >» 

DO  33  I=1,N1 
DO  77  < = 1 , I 3 
DO  7?  J= 1 , 1 3 
0(<»J, 121*0.0 

READ(ITIN)  ( (A(KK»JX),KK=l»Nl) ,JK*1,N1) 

N1D0T=I-1 

XNlDoTsNlDOT 

DO  22  J= 1 ,N 1 

NDOTl=J-l 

XNDOTlsNCOTl 

XNL=XN1D0T*X| *2»XND0T1»XL*3-XN»XL* 
XNU=XMDOT*Xll*2*XNDOTl»XU*3-XN*XU* 


9620  C 
9630  C 
96*0  C 
9650 
9660 
9670  C 
9660  C 
9690  C 
9700  C 
9710  C 
9720  C 
9730 
97*0 
9750 
9760 
9770  C 
9780  C 
9790  C 
9800 
9610 
9820 
9830 
98*0 
9850 
9860 
9870 
9880  15 
9890 
99C0 
9910  C 
9920  C 
9930  C 
99*0 
9950 
9960 
9970 
9980 
9990  C 
10000  C 
10010  C 
10020 
10030 
100*0 
10050 
10060 
10070  C 
10080  C 
10090  C 
10100  200 
101 10 

10120  8001 


FIGURE  LOrfER  AND  UPPER  LIMITS  ON  Nil 

IU«MJN0(ND0T1 «N1D0T) *1 
IL*MAX0(ND0T1*N1D0T-N.0)*i 

SKIP  IF  REGIONS  ARE  KNOrtN  AND  ALREADY  SAVED  ON  UNIT  ITREG 


FIGURE  CRITICAL  VALUES  OF  REGIONS 

KL1*1LNT< (AL UXNL! /ZLI-1UP 
KU1*ILNT<  <OLUXNLi/ZL)-lUP*l 
KL2*ILNT( (AL2*XNU)/ZUI*IUP 
KU2* ILNT ( (bl2*XNU)/ZU) ♦ IUP* 1 

<<<  ENUMERATE  POSSIBILITIES  FDR  CURRENT  REGIONS  »» 

DO  11  KsILtlU 

XlsK-1 

K2«X  1 

X2.N1D0T-K2 
X3*ND0T1-K2 
X*xN.ni00T-ND0T1*X2 
PROBsA (X , J) 

IF(PROB) 15,20,15 
UPl*x2.GE.KUl 
PROB25iPROB«.25 
DOwN2*K2.LE.KL2 

DETERMINE  PROPER  ACTION. 

IF( ( jPl.ANC.D0rfN2))  GO  TO  *00 
DOwNj  sK2.Ll.KLl 
lE(D0*Nl.ANP.D0ir<N2)  GO  TO  200 
UP2s<2.GE.Kl,2 
I F (UP  1 . AND.UP2 ) GO  TO  300 

IF  THIS  IS  A CONTINUATION  POINT,  SEND  PROBABILITIES  TO  NEXT  STEP 

B(K.J,I2)«P(K,J,!2> »PROB25 
B(K.l,j«l , I2)sB(K*l,J*l.I2)*PR0B25 
B(K,J«1,I1)sB(K,J«1,11)*PR0025 
B(K,J,I1)sE(K,J,I11»PR0B25 
GO  TO  20 

ACCUMULATE  PROBABILITIES  FOR  A TERMINATION  POINT. 

DO  ROCl  IV=1,NALT 

ACfl  (IV)=ACC1 (IV) ♦PR0B»C0EF(P1 (IV) ,P2( IV) ,P3(IV) ,P*(IV) ,0) 
CONTINUE 


6 


160 


10130 
10  U0  300 
10150 

10160  6002 
10170 
10160  400 
10190 

10200  6003 
10210  20 
10220  11 
10230  22 
10240 
10250 
10260 
10270 
10280  33 
10290 
10300 
10310 
10320 
10330 
10340 
10350  C 
10360  C 
10370  C 
10360 
10390 
10400 
10410 
10420 
10430 
10440 

10450  8005 

10460  34 

10470 

10480 

10490 

10500 

10510 

10520  6565 

10530 

10540 

10550 

10560 

10570 

10580 

10590 

10600 

10610  4562 
10620  3459 
10630  99 


GO  TO  20 

DO  8002  iVtl.NALT 

ACC?(IV)xACC2(IV)*PROB«COEF(P1  (IV)  ,P2 ( l V) ,P3 ( I V) .P4 ( I V) .0) 

continue 

GO  TO  20 

00  8003  IVsl.NALT 

ACCo (IV) sACCO < IV) ♦PROB*COEF CPI (IV) .P2 C I V) »P3 C IV) .P4 ( I V) .0) 

continue 

continue 

continue 

CONTINUE 

WRITE (I  TOUT  ) ( (BUJ.JK.I 1) «<Jal«l3) «JK*1.I3» 

IhOlO*I1 

11*12 

I2*!H0L0 

CONTINUE 

WRITE (I  TOUT  ) < <B (KK , JK • I 1 > ,<K*1,I3) .JK*1.I3) 

CALL  SETSCT ( ITOUT «1 ) 

CALL  SETSCT ( I T IN* 1 ) 

IHOlDFxITIN 

ITlN*ITOUT 

ITOuTxIHOLOF 

ACCUMULATE  PROBABILITIES  AND  EXPECTED  VALUES. 

DO  8005  IVsI.NALT 
T9=aCC0(IV) *ACC1 (IV) *ACC2 (IV) 

ACC7T(1V)=ACC2T(IV)*ACC2(IV) 

ACClT  < IV) =ACC1T (IV) ♦ACCl (IV) 

ACCOT(IV) sACCOT(lV) *ACCO(IV) 

NT9xFL0AT  (Nl »T9 
N9  1 1 V) *N9 ( I V) «NT9 
CONTlNUt 
CONTINUE 

DO  6565  Ixl.NALT 

pi  (i)sExP(PKH) 

P2 ( I ) *EXP (P2 ( I ) ) 

P3 ( I ) *EXP (P3 ( I ) ) 

P4(I)sEXP(P4(U ) 

CONTINUE 

DO  3459  Ixl.NALT 

WRlTE(ICUT,4562)Pl (I) .P2(I) ,P3 ( I ) ,P4 ( I ) , ACClT ( I ) 

6 . ACCOT ( 1 1 « ACC2T ( I ) *N9 ( I ) 

f.PCH(I) 

IF(IPUN.EO.I) 

C WRITE ( I POUT. 4562) PI (I) ,P2 (I) ,P3(I) .P4(I> .ACCiT(I) 
t , ACCOT ( I ) .ACC2T ( I ) «N9 ( I ) 

8.PCh ( I ) 

FOPMAT ( 1X.4F6.3.3F10.5.F12.3.F10.5) 

CONTINUE 
PRINT  456 


170 


10640  456 
10650 
10660 
10670  C 
10600  O* 
10690  C* 
10700  C« 
10710  C» 
10720  C* 
10730  C*« 
10740  C 
10750  C 
10760  C 
10770  C 
10780 
10790 
10600 
10810 
10820  C 
10830  C 
10840  C 
10850 
10860 
10870 
10880 
10890 
10900 
10910 
10920 
10930  22 
10940 
10950 
10960 
10970 
10980 
10990 
1 1000 
11010 
11020  C 
11030  C 
11040  C 
11050  C 
11060  C 
11070  C 
11080 
11090 
11100 
11110 
11120  C 
11130  C 
11U0  C 


FORMAT  coeno  of  RUN*) 

STOP 

END 


SUBROUTINFS  used  in  the  programs  for  sequential  analysis 

OF  2x2  CONTINGENCY  TABLES. 


RETURN  LOG  BINOMIAL  COEFFICIENT 

function  bicofin.iri  ' 

BIC0F=FLNG(N)-FLNG(IR)-FLNG(N-IR1 

RETuRN 

end 

FUNCTION  TO  DETERMINE  THE  LIKLIHOOD  RATIO 

FJNCTION  FM0D(ND0T1,N1D0T,N,AT) 

COMMON  IL.IU 
TOPnUM* BICOF (N.ND0T1 ) 

Fn0d*0. 

DO  22  I*IL.IU 
J*I-1 

FNOOsFNOD.ExP ( B I COF ( N1D0T  * J)  .BICOF (N-N1D0T .ND0T1-J) .FLOAT (J) »AT- 
t TOPNUM) 

CONTINUE 

FnODs-ALOG(FNOD) 

return 

END 

FUNCTION  C0EF(P1,P2,P3.P4,Q) 
common  I L . IU,0(4I ,X1 .X2.X3.X4 
C0FFstXP(Xl«Pl.X2»P2.X3»P3.X4»P4-Q) 

RETURN 

end 

FUNCTION  TO  RETURN  THE  NATURAL  LOG  FACTORIAL 


RETURN  LOG  BINOMIAL  COEFFICIENT 

FUNCTION  BICOF (N»IR) 

BICdFsFLNGJN)  -FLNGdR)-FLNG(N-IR) 

return 

END 

FUNCTION  TO  DETERMINE  THE  LULlHOOD  RATIO 


MMuiMiMiBHittaiMM 


I 
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11150  C 

*? 

11160  C 

11170  C 

FUNCTION  TO  RETURN  THE  NATURAL  LOG  FACTORIAL 

«* 

11100  C 

11190 

FUNCTION  FLNG1J) 

11200 

DIMENSION  F 1 105) 

11210 

DATA  MARK/1/ 

11220 

IF (MARK) 20.20*21 

11230  20 

FLNf,*F(J*l) 

11240 

return 

11250  21 

F(1)*0. 

11260 

F{2)«0. 

- 

11270 

DO  22  I <3 < 103 

11200 

f<  h*F  (i-  iwalog  <float  ( l-i  n 

11290  22 

CONTINUE 

11300 

maRk»o 

i 

11310 

GO  TO  20 

11320 

END 

11330  C 

11340  C 

THIS  FUNCTION  RETURNS  THE  GREATEST  INTEGER  .LE.  X 

11350 

FUNCTION  ILNT(X) 

1 

11360 

X*X*.OOI 

11370 

IT (X) 1*2*3 

11300  1 

ilnt«ifix(xi-i 

11390 

GO  TO  2 

11400  3 

ilnt*ifixix» 

11410  2 

return 

11420 

END 

